Pass IndexThe State of AISign in

Tokens per second

How fast the answer streams once it has started.

how it is measured · the vocabulary

tok/sthroughput

Around 20 tokens a second matches comfortable reading. Below that a person waits; far above it the number only matters if a program, not a person, is consuming the output. Sellers of the same open-weight model compete mostly on this and on price.

Nearby

ARC-AGIBenchmarkBenchmark contaminationEloEval setGPQAHumanEvalLLM as judge