Video mme — Epoch AI

Video mme — Epoch AI is run by Epoch AI. It has ranked 50 models, of which the catalogue holds 12, scoring from 0.411 to 0.735.

measured by Epoch AI · the board itself

Place	Model	Metric	Score
4thof 50	Qwen2.5 VL 72B Instruct	Overall (no subtitles)	0.735
6thof 50	GPT-4o (2024-11-20)	Overall (no subtitles)	0.719
7thof 50	GPT-4o (2024-08-06)	Overall (no subtitles)	0.719
8thof 50	Qwen 2 VL 72B Instruct	Overall (no subtitles)	0.712
12thof 50	Aria	Overall (no subtitles)	0.676
20thof 50	GPT-4o-mini (2024-07-18)	Overall (no subtitles)	0.648
24thof 50	Qwen2-VL-7B-Instruct	Overall (no subtitles)	0.639
25thof 50	MiniCPM-o-2_6	Overall (no subtitles)	0.639
28thof 50	MiniCPM-V-2_6	Overall (no subtitles)	0.609
29thof 50	Claude 3.5 Sonnet	Overall (no subtitles)	0.6
41stof 50	Qwen-VL Max	Overall (no subtitles) (max)	0.513
45thof 50	Qwen-VL-Chat	Overall (no subtitles)	0.411

Place

Model

Metric

Score

4thof 50

Overall (no subtitles)

0.735

6thof 50

Overall (no subtitles)

0.719