MMLU
A multiple-choice exam of about 16,000 questions across 57 subjects, from law to microbiology.
how it is measured · the vocabulary
MMLU-Pro
The benchmark that defined the last generation and is now largely saturated — the good models cluster within a point or two, which measures nothing. MMLU-Pro is the harder replacement.