Pass IndexThe State of AISign in

Aider polyglot coding leaderboard

Aider polyglot coding leaderboard is run by Aider. It has ranked 69 models, of which the catalogue holds 40, scoring from 3.6 to 88 on Percent correct.

measured by Aider · the board itself

PlaceModelMetricScore
1stof 69GPT-5Percent correct (high)88
3rdof 69o3-proPercent correct (high)84.9
4thof 69Gemini 2.5 Pro Preview 06-05Percent correct83.1
6thof 69o3Percent correct (high)81.3
7thof 69Grok 4Percent correct (high)79.6
9thof 69GPT-4.1Percent correct78.2
11thof 69Gemini 2.5 Pro Preview 05-06Percent correct76.9
12thof 69DeepSeek V3.2 ExpPercent correct74.2
13thof 69Gemini 2.5 ProPercent correct72.9
14thof 69Claude Opus 4Percent correct72
15thof 69o4 Mini HighPercent correct (high)72
16thof 69DeepSeek-R1 (0528)Percent correct71.4
19thof 69Claude 3.7 SonnetPercent correct64.9
20thof 69Claude 3.5 SonnetPercent correct64
21stof 69o1Percent correct (high)61.7
22ndof 69Claude Sonnet 4Percent correct61.3
24thof 69o3 Mini HighPercent correct (high)60.4
25thof 69Qwen3 235B A22BPercent correct59.6
26thof 69Kimi K2 0711Percent correct59.1
27thof 69DeepSeek-R1Percent correct56.9
29thof 69Gemini 2.5 FlashPercent correct55.1
30thof 69DeepSeek-V3 0324Percent correct55.1
32ndof 69o3-miniPercent correct (medium)53.8
40thof 69OpenAI ChatGPT-4oPercent correct45.3
43rdof 69GPT OSS 120BPercent correct (high)41.8
44thof 69Qwen3 32BPercent correct40
48thof 69o1-miniPercent correct32.9
49thof 69GPT-4.1 miniPercent correct32.4
50thof 69Claude Haiku 3.5Percent correct28
53rdof 69GPT-4o (2024-08-06)Percent correct23.1
54thof 69Gemini 2.0 FlashPercent correct22.2
56thof 69QwQ-32BPercent correct20.9
58thof 69GPT-4o (2024-11-20)Percent correct18.2
60thof 69Qwen2.5 Coder 32B InstructPercent correct16.4
61stof 69Llama 4 Maverick 17BPercent correct15.6
64thof 69Codestral 25.01Percent correct11.1
65thof 69openhands-lm-32b-v0.1Percent correct10.2
66thof 69GPT-4.1 nanoPercent correct8.9
68thof 69Gemma 3 27BPercent correct4.9
69thof 69GPT-4o-mini (2024-07-18)Percent correct3.6

Read from the board on 2026-09-16