Directory label
Knowledge benchmarks for LLMs and RL environments
A label other catalogs put on entries, not one of the domains on our map. On the map, each entry here sits in the domain its own site or paper leads with.
Factual and expert knowledge across many subjects, tested with closed-book questions that each have one verifiable answer.
- AI benchmarks
- 144
- Shares entries with
- 1 category
Snapshot 2026-11-05. How categories are built · Where the data comes from
In short
- What are the main knowledge benchmarks for LLMs?
- GPQA-D, MMLU-Pro, GPQA, HLE-Verified, SimpleQA and ARC-AGI v2, among 129 confirmed below.
Only benchmarks use the Knowledge tag: the RL environment directories file their vendors under other categories. Browse all RL environments.
AI benchmarks 144
-
GPQA-D
No line from its own site or paper places it in Knowledge yet; the catalog lists it here.
-
MMLU-Pro
No line from its own site or paper places it in Knowledge yet; the catalog lists it here.
-
GPQA
No line from its own site or paper places it in Knowledge yet; the catalog lists it here.
-
HLE-Verified
No line from its own site or paper places it in Knowledge yet; the catalog lists it here.
-
SimpleQA
No line from its own site or paper places it in Knowledge yet; the catalog lists it here.
-
ARC-AGI v2
No line from its own site or paper places it in Knowledge yet; the catalog lists it here.
-
HELM MMLU
No line from its own site or paper places it in Knowledge yet; the catalog lists it here.
-
CorpFin v2
No line from its own site or paper places it in Knowledge yet; the catalog lists it here.
-
CaseLaw v2
No line from its own site or paper places it in Knowledge yet; the catalog lists it here.
-
HealthBench
No line from its own site or paper places it in Knowledge yet; the catalog lists it here.
-
HealthBench Professional
No line from its own site or paper places it in Knowledge yet; the catalog lists it here.
-
SpatialBench Verified
No line from its own site or paper places it in Knowledge yet; the catalog lists it here.
-
SingleCellBench
No line from its own site or paper places it in Knowledge yet; the catalog lists it here.
-
ProteinGym Hard
No line from its own site or paper places it in Knowledge yet; the catalog lists it here.
-
LABBench2
No line from its own site or paper places it in Knowledge yet; the catalog lists it here.
-
HealthBench Hard
No line from its own site or paper places it in Knowledge yet; the catalog lists it here.
-
MMMLU
No line from its own site or paper places it in Knowledge yet; the catalog lists it here.
-
C-Eval
No line from its own site or paper places it in Knowledge yet; the catalog lists it here.
-
MedCode
No line from its own site or paper places it in Knowledge yet; the catalog lists it here.
-
MedScribe
No line from its own site or paper places it in Knowledge yet; the catalog lists it here.
-
LegalBench
No line from its own site or paper places it in Knowledge yet; the catalog lists it here.
-
TaxEval v2
No line from its own site or paper places it in Knowledge yet; the catalog lists it here.
-
MedQA
No line from its own site or paper places it in Knowledge yet; the catalog lists it here.
-
BoolQ
No line from its own site or paper places it in Knowledge yet; the catalog lists it here.
-
FutureEval
No line from its own site or paper places it in Knowledge yet; the catalog lists it here.
-
GQA
No line from its own site or paper places it in Knowledge yet; the catalog lists it here.
-
HELM
No line from its own site or paper places it in Knowledge yet; the catalog lists it here.
-
HELM Lite
No line from its own site or paper places it in Knowledge yet; the catalog lists it here.
-
SEED-Bench
No line from its own site or paper places it in Knowledge yet; the catalog lists it here.
-
SQuAD 2.0
No line from its own site or paper places it in Knowledge yet; the catalog lists it here.
-
VCR
No line from its own site or paper places it in Knowledge yet; the catalog lists it here.
-
HotpotQA
No line from its own site or paper places it in Knowledge yet; the catalog lists it here.
-
Natural Questions
No line from its own site or paper places it in Knowledge yet; the catalog lists it here.
-
NYT Connections Extended
No line from its own site or paper places it in Knowledge yet; the catalog lists it here.
-
ObviousBench
No line from its own site or paper places it in Knowledge yet; the catalog lists it here.
-
ZebraLogic
No line from its own site or paper places it in Knowledge yet; the catalog lists it here.
-
FACTS Grounding
No line from its own site or paper places it in Knowledge yet; the catalog lists it here.
-
CMMLU
No line from its own site or paper places it in Knowledge yet; the catalog lists it here.
-
SuperGPQA
No line from its own site or paper places it in Knowledge yet; the catalog lists it here.
-
OpenBookQA
No line from its own site or paper places it in Knowledge yet; the catalog lists it here.
-
MultiNRC
No line from its own site or paper places it in Knowledge yet; the catalog lists it here.
-
PRBench Finance
No line from its own site or paper places it in Knowledge yet; the catalog lists it here.
-
PRBench Legal
No line from its own site or paper places it in Knowledge yet; the catalog lists it here.
-
SciPredict
No line from its own site or paper places it in Knowledge yet; the catalog lists it here.
-
TutorBench
No line from its own site or paper places it in Knowledge yet; the catalog lists it here.
-
Balrog
No line from its own site or paper places it in Knowledge yet; the catalog lists it here.
-
BIG-bench
No line from its own site or paper places it in Knowledge yet; the catalog lists it here.
-
MMBench-CN
No line from its own site or paper places it in Knowledge yet; the catalog lists it here.
-
OK-VQA
No line from its own site or paper places it in Knowledge yet; the catalog lists it here.
-
POPE
No line from its own site or paper places it in Knowledge yet; the catalog lists it here.
-
SEED-Bench-2
No line from its own site or paper places it in Knowledge yet; the catalog lists it here.
-
SuperGLUE
No line from its own site or paper places it in Knowledge yet; the catalog lists it here.
-
TableBench
No line from its own site or paper places it in Knowledge yet; the catalog lists it here.
-
VQAv2
No line from its own site or paper places it in Knowledge yet; the catalog lists it here.
-
Altered Riddles
No line from its own site or paper places it in Knowledge yet; the catalog lists it here.
-
BIG-Bench Extra Hard
No line from its own site or paper places it in Knowledge yet; the catalog lists it here.
-
ChartBench
No line from its own site or paper places it in Knowledge yet; the catalog lists it here.
-
EgoSchema
No line from its own site or paper places it in Knowledge yet; the catalog lists it here.
-
InfographicVQA
No line from its own site or paper places it in Knowledge yet; the catalog lists it here.
-
IntentGrasp
No line from its own site or paper places it in Knowledge yet; the catalog lists it here.
-
LingOly-TOO
No line from its own site or paper places it in Knowledge yet; the catalog lists it here.
-
MSRVTT-QA
No line from its own site or paper places it in Knowledge yet; the catalog lists it here.
-
OJBench
No line from its own site or paper places it in Knowledge yet; the catalog lists it here.
-
WikiSQL
No line from its own site or paper places it in Knowledge yet; the catalog lists it here.
-
MMLU
No line from its own site or paper places it in Knowledge yet; the catalog lists it here.
-
MMLU-Redux
No line from its own site or paper places it in Knowledge yet; the catalog lists it here.
-
AGIEval
No line from its own site or paper places it in Knowledge yet; the catalog lists it here.
-
TruthfulQA
No line from its own site or paper places it in Knowledge yet; the catalog lists it here.
-
TriviaQA
No line from its own site or paper places it in Knowledge yet; the catalog lists it here.
-
AI2D
No line from its own site or paper places it in Knowledge yet; the catalog lists it here.
-
AIR-Bench
No line from its own site or paper places it in Knowledge yet; the catalog lists it here.
-
ARC Challenge
No line from its own site or paper places it in Knowledge yet; the catalog lists it here.
-
ARC Easy
No line from its own site or paper places it in Knowledge yet; the catalog lists it here.
-
AudioBench
No line from its own site or paper places it in Knowledge yet; the catalog lists it here.
-
Clotho-AQA
No line from its own site or paper places it in Knowledge yet; the catalog lists it here.
-
CommonsenseQA
No line from its own site or paper places it in Knowledge yet; the catalog lists it here.
-
Global PIQA
No line from its own site or paper places it in Knowledge yet; the catalog lists it here.
-
MMBench
No line from its own site or paper places it in Knowledge yet; the catalog lists it here.
-
QASC
No line from its own site or paper places it in Knowledge yet; the catalog lists it here.
-
StrategyQA
No line from its own site or paper places it in Knowledge yet; the catalog lists it here.
-
YouCook2
No line from its own site or paper places it in Knowledge yet; the catalog lists it here.
-
Artificial Intelligence Quotient (AIQ) Benchmark
No line from its own site or paper places it in Knowledge yet; the catalog lists it here.
-
AutoLogi
No line from its own site or paper places it in Knowledge yet; the catalog lists it here.
-
COPA
No line from its own site or paper places it in Knowledge yet; the catalog lists it here.
-
ECLeKTic
No line from its own site or paper places it in Knowledge yet; the catalog lists it here.
-
FINAL Bench Metacognitive
No line from its own site or paper places it in Knowledge yet; the catalog lists it here.
-
Gaokao-Bench
No line from its own site or paper places it in Knowledge yet; the catalog lists it here.
-
LLaVA-Bench in the Wild
No line from its own site or paper places it in Knowledge yet; the catalog lists it here.
-
MEGA XCOPA
No line from its own site or paper places it in Knowledge yet; the catalog lists it here.
-
MVBench
No line from its own site or paper places it in Knowledge yet; the catalog lists it here.
-
NPHardEval
No line from its own site or paper places it in Knowledge yet; the catalog lists it here.
-
PlotQA
No line from its own site or paper places it in Knowledge yet; the catalog lists it here.
-
Social IQa
No line from its own site or paper places it in Knowledge yet; the catalog lists it here.
-
HLE-Diamond
No line from its own site or paper places it in Knowledge yet; the catalog lists it here.
-
AA-HLE
No line from its own site or paper places it in Knowledge yet; the catalog lists it here.
-
Chinese-SimpleQA
No line from its own site or paper places it in Knowledge yet; the catalog lists it here.
-
HLE w/o tools
No line from its own site or paper places it in Knowledge yet; the catalog lists it here.
-
SimpleQA Verified
No line from its own site or paper places it in Knowledge yet; the catalog lists it here.
-
HLE Extended
No line from its own site or paper places it in Knowledge yet; the catalog lists it here.
-
FACTS Benchmark Suite
No line from its own site or paper places it in Knowledge yet; the catalog lists it here.
-
AA Openness Index
No line from its own site or paper places it in Knowledge yet; the catalog lists it here.
-
Artificial Analysis Intelligence Index
No line from its own site or paper places it in Knowledge yet; the catalog lists it here.
-
DrugDiscoveryBench
No line from its own site or paper places it in Knowledge yet; the catalog lists it here.
-
FORTRESS
No line from its own site or paper places it in Knowledge yet; the catalog lists it here.
-
GaRAGe
No line from its own site or paper places it in Knowledge yet; the catalog lists it here.
-
Protein Design
No line from its own site or paper places it in Knowledge yet; the catalog lists it here.
-
Morphology-to-molecule matching
No line from its own site or paper places it in Knowledge yet; the catalog lists it here.
-
Protein Design library ranking
No line from its own site or paper places it in Knowledge yet; the catalog lists it here.
-
FrontierScience
No line from its own site or paper places it in Knowledge yet; the catalog lists it here.
-
AA-Omniscience Index
No line from its own site or paper places it in Knowledge yet; the catalog lists it here.
-
AA-Omniscience Accuracy
No line from its own site or paper places it in Knowledge yet; the catalog lists it here.
-
Kimi Hallu Bench
No line from its own site or paper places it in Knowledge yet; the catalog lists it here.
-
FrontierScience Research
No line from its own site or paper places it in Knowledge yet; the catalog lists it here.
-
MultiLoKo
No line from its own site or paper places it in Knowledge yet; the catalog lists it here.
-
FACTS Parametric
No line from its own site or paper places it in Knowledge yet; the catalog lists it here.
-
Immigration Bench
No line from its own site or paper places it in Knowledge yet; the catalog lists it here.
-
SUPERChem
No line from its own site or paper places it in Knowledge yet; the catalog lists it here.
-
ActivityNet-QA
No line from its own site or paper places it in Knowledge yet; the catalog lists it here.
-
AIIQ Composite IQ
No line from its own site or paper places it in Knowledge yet; the catalog lists it here.
-
CAIS Text Capabilities Index
No line from its own site or paper places it in Knowledge yet; the catalog lists it here.
-
FEVER
No line from its own site or paper places it in Knowledge yet; the catalog lists it here.
-
HELM Instruct
No line from its own site or paper places it in Knowledge yet; the catalog lists it here.
-
OpenAI Evals
No line from its own site or paper places it in Knowledge yet; the catalog lists it here.
-
WikiTableQuestions
No line from its own site or paper places it in Knowledge yet; the catalog lists it here.
-
GeoQA
No line from its own site or paper places it in Knowledge yet; the catalog lists it here.
-
HANS
No line from its own site or paper places it in Knowledge yet; the catalog lists it here.
-
LLaVA-Bench
No line from its own site or paper places it in Knowledge yet; the catalog lists it here.
-
MEGA XStoryCloze
No line from its own site or paper places it in Knowledge yet; the catalog lists it here.
-
ST-VQA
No line from its own site or paper places it in Knowledge yet; the catalog lists it here.
15 not yet confirmedListed in the catalog; no line from its own site or paper confirms it yet.
Next: pick another domain. Tags come from the RL Research daily scrape, canonicalized nightly.