Benchmark
A fixed set of questions every model is asked, so their answers can be compared.
how it is measured · the vocabulary
evalleaderboard
Useful and never sufficient. A benchmark measures what it measures; models are trained knowing it exists; and a rank means little without the size of the field, which is why this site always prints "3rd of 152" rather than "3rd".