HLE (Mercor) S
AI benchmark · Knowledge
What is HLE (Mercor)?
Answering difficult academic questions across many subjects. This table shows Mercor-run configurations for reference and is excluded from model rankings.
Tier S
The standard: frontier labs report it, or a trusted evaluator scores hundreds of models on it.
How much stands behind a tier: usage, who backs it, a confirmed line from its own site or paper, and a clear read on X. High with three of the four, medium with two, low otherwise.
- 465 models scored
- built by Scale AI
- in curated RL directories (4 pts)
On X · well regarded, moderate buzz, from 6 posts about HLE (Mercor) in the last month
HLE is routinely cited in lab model launches like Haiku 5.5 and Beam as the hard-reasoning yardstick; one note mentions growing contamination blocklists.
How we got to tier S
- Adoption: 465 models scored; built by Scale AI. Tier S.
- On X: well regarded, moderate buzz. “HLE is routinely cited in lab model launches like Haiku 5.5 and Beam as the hard-reasoning yardstick; one note mentions growing contamination blocklists.” No move.
- In curated RL directories: 4 points, a floor of B.
- Confirmed: a line from its own site or paper places it.
A clear view on X moves a tier one step up or down; most entries don't move. How tiers work.
Not on the map yet: no line from its own site or paper places it in a domain.
Next: browse all benchmarks. Entry from the RL Research daily scrape of public sources, 2026-10-11 snapshot.