GPQA
Graduate-level science questions written to be hard for anyone who is not a specialist, and unsearchable on the web.
how it is measured · the vocabulary
GPQA Diamond
The "Diamond" subset is the one usually quoted. It resists contamination better than most, which is why it stayed useful longer.