Pass IndexThe State of AISign in

Swe bench verified — Epoch AI

Swe bench verified — Epoch AI is run by Epoch AI. It has ranked 35 models, of which the catalogue holds 32, scoring from 30.992 to 83.471.

measured by Epoch AI · the board itself

PlaceModelMetricScore
1stof 35Claude Opus 4.7mean_score (max)83.471
2ndof 35GPT-5.5mean_score (xhigh)80.579
3rdof 35Gemini 3.5 Flashmean_score (high)79.339
4thof 35Claude Opus 4.6mean_score78.719
5thof 35GLM 5.2mean_score (max)78.7
6thof 35DeepSeek V4 Promean_score (max)77.64
7thof 35Qwen3.7 Maxmean_score (max)77.273
8thof 35GPT-5.4mean_score (high)76.86
9thof 35Qwen3.6 Max Previewmean_score (max)76.653
10thof 35Kimi K2.6mean_score76.653
11thof 35Claude Opus 4.5mean_score76.653
12thof 35Gemini 3.1 Pro Preview Custom Toolsmean_score75.62
14thof 35Gemini 3 Flash Previewmean_score75.413
15thof 35Claude Sonnet 4.6mean_score75.207
16thof 35GPT-5.3 Codexmean_score (high)74.793
17thof 35GLM 5.1mean_score74.17
18thof 35Kimi K2.5mean_score73.76
19thof 35GPT-5.2mean_score (high)73.76
20thof 35GPT-5mean_score (high)73.554
21stof 35Claude Opus 4.1mean_score73.347
22ndof 35gemini-3-pro-previewmean_score72.934
23rdof 35GLM-5mean_score72.078
25thof 35Claude Sonnet 4.5mean_score71.281
26thof 35Claude Opus 4mean_score70.661
27thof 35GPT-5.1mean_score (high)67.975
29thof 35GPT-5 minimean_score (medium)64.669
30thof 35o3mean_score (medium)62.319
31stof 35Claude 3.7 Sonnetmean_score60.95
32ndof 35Qwen3.6 Plusmean_score57.851
33rdof 35Gemini 2.5 Promean_score57.557
34thof 35GPT-4.1 fine-tunedmean_score48.542
35thof 35GPT-4o (2024-11-20)mean_score30.992

Read from the board on 2026-09-16