HLE S

AI benchmark · Knowledge

Domains
Knowledge
Tier
S why
Snapshot

What is HLE?

An expert-authored benchmark designed to probe frontier knowledge and reasoning.

Tier S

S

The standard: frontier labs report it, or a trusted evaluator scores hundreds of models on it.

How much stands behind a tier: usage, who backs it, a confirmed line from its own site or paper, and a clear read on X. High with three of the four, medium with two, low otherwise.

  • 478 models scored
  • listed with Scale AI
  • in curated RL directories (4 pts)

On X · well regarded, moderate buzz, from 9 posts about HLE in the last month

The new refined HLE-Diamond version was added to Artificial Analysis's index with top models near 69%; some note score gaps are within noise.

@ArtificialAnlys ↗ · @ArtificialAnlys ↗ · @trefoxx1 ↗

How we got to tier S
  1. Adoption: 478 models scored; listed with Scale AI. Tier S.
  2. On X: well regarded, moderate buzz. “The new refined HLE-Diamond version was added to Artificial Analysis's index with top models near 69%; some note score gaps are within noise.” No move.
  3. In curated RL directories: 4 points, a floor of B.
  4. Confirmed: a line from its own site or paper places it.

A clear view on X moves a tier one step up or down; most entries don't move. How tiers work.

Not on the map yet: no line from its own site or paper places it in a domain.

Next: browse all benchmarks. Entry from the RL Research daily scrape of public sources, 2026-11-05 snapshot.