Pass IndexThe State of AISign in

Claude Haiku 3.5

Retired Anthropic model, API ID claude-3-5-haiku-20241022.

text → text · made by Anthropic

$0.8$4per Mtok in / out
Anthropic · 3 sellers

Sold by 4 ways

SellerLaneRate
Anthropic apibatch$0.4per Mtok in$2per Mtok outplatform.claude.com · read 2026-08-24
AWS Bedrock cloudstandard$0.8per Mtok in$4per Mtok out$0.08per Mtok cached$1per Mtok cache writeraw.githubusercontent.com · read 2026-09-16
Anthropic apistandard$0.8per Mtok in$4per Mtok out$0.08per Mtok cached$1per Mtok cache writeplatform.claude.com · read 2026-08-24
DigitalOcean cloudstandard$0.8per Mtok in$4per Mtok out$0.08per Mtok cached$1per Mtok cache writemodels.dev · read 2026-09-16

Measured 18 standings

PlaceBoardMetricScore
10thof 15Cad eval — Epoch AIOverall pass (%)0.32
24thof 36Balrog — Epoch AIAverage progress0.193
35thof 49Lech mazur writing — Epoch AIMean score7.35
40thof 54Live bench — Epoch AIGlobal average43.45
50thof 69Aider polyglot coding leaderboardPercent correct28
54thof 72Aider polyglot — Epoch AIPercent correct28
54thof 217Mmlu — Epoch AIEM0.743
67thof 108Math level 5 — Epoch AImean_score46.356
97thof 101FrontierMath (Tiers 1-3)mean_score0.345
114thof 152LMArena · VisionScore (Elo)1127
125thof 161Dtbench — Epoch AIAccuracy56.66
146thof 170Weirdml — Epoch AIAccuracy30.73
147thof 177Critpt — Epoch AIAccuracy0
154thof 168Scicode — Epoch AIScore27.431
239thof 402LMArena · TextScore (Elo)1324
263rdof 290OTIS Mock AIME 2024-2025mean_score4.306
270thof 313GPQA Diamondmean_score38.131
545thof 656Epoch capabilities index — Epoch AIECI Score127.15

About

Claude Haiku 3.5 — a text model from Anthropic, sold by 3 companies from $0.8 in and $4 out per million tokens, placed 54th of 217 on Mmlu — Epoch AI.

It takes text and returns text, with a context window of 200,000 tokens. It was published in October 2024. Its sellers say it can call a tool. The catalogue files it under reasoning and code. Three companies sell it. The cheapest is $0.8 in and $4 out per million tokens at AWS Bedrock. Beside the standard rate there is a batch lane. It has been measured on 18 boards, and stands best at 54th of 217 on Mmlu — Epoch AI.

Every current figure

Maker
Anthropic
Register
model
Takes
text
Returns
text
Context
200,000 tokens
Longest answer
64,000 tokens
Published
October 2024
Licence
not read
Sellers
3
Price
$0.8 in and $4 out per million tokens — AWS Bedrock
Boards
18
Best place
54th of 217 — Mmlu — Epoch AI

Known as 1 name

Claude 3.5 Haiku