CritPt B
AI benchmark · Science
What is CritPt?
Research-level physics reasoning benchmark with composite challenges designed by active physics researchers.
Tier B
B
Established: 15 or more models scored, or curated RL directories rate it.
How much stands behind a tier: usage, who backs it, a confirmed line from its own site or paper, and a clear read on X. High with three of the four, medium with two, low otherwise.
- 101 models scored
- in curated RL directories (2 pts)
On X · poorly regarded, moderate buzz, from 14 posts about CritPt in the last month
An expert audit found errors in 21 of 56 CritPt questions, and corrected scores near saturation, so many now call it broken despite its use in Artificial Analysis rankings.
How we got to tier B
- Adoption: 101 models scored. Tier A.
- On X: poorly regarded, moderate buzz. “An expert audit found errors in 21 of 56 CritPt questions, and corrected scores near saturation, so many now call it broken despite its use in Artificial Analysis rankings.” Moved down to B.
- In curated RL directories: 2 points, a floor of C.
- Not yet confirmed by a line from its own site or paper.
A clear view on X moves a tier one step up or down; most entries don't move. How tiers work.
Not on the map yet: no line from its own site or paper places it in a domain.
Next: browse all benchmarks. Entry from the RL Research daily scrape of public sources, 2026-10-11 snapshot.