HealthBench A
AI benchmark · Knowledge
Full listing name: HealthBench (raw)
What is HealthBench?
Raw score on realistic multi-turn healthcare conversations graded against expert-written rubrics.
Tier A
Widely used: a lab reports it, or 50 or more models are scored on it.
How much stands behind a tier: usage, who backs it, a confirmed line from its own site or paper, and a clear read on X. High with three of the four, medium with two, low otherwise.
- 29 models scored
- reported by OpenAI
- in curated RL directories (2 pts)
On X · well regarded, moderate buzz, from 10 posts about HealthBench in the last month
HealthBench (including Pro and Hard variants) is routinely cited in frontier model launches like Grok 4.7 and Ling-3.1, though one paper flags rubric-judge self-preference bias.
How we got to tier A
- Adoption: 29 models scored; reported by OpenAI. Tier A.
- On X: well regarded, moderate buzz. “HealthBench (including Pro and Hard variants) is routinely cited in frontier model launches like Grok 4.7 and Ling-3.1, though one paper flags rubric-judge self-preference bias.” No move.
- In curated RL directories: 2 points, a floor of C.
- Not yet confirmed by a line from its own site or paper.
A clear view on X moves a tier one step up or down; most entries don't move. How tiers work.
Not on the map yet: no line from its own site or paper places it in a domain.
Next: browse all benchmarks. Entry from the RL Research daily scrape of public sources, 2026-10-11 snapshot.