HLE-MultiChoice D

AI benchmark · Decision Models

Built by
Artificial Analysis
Tier
D why
Snapshot

Open benchmark ↗huggingface.co/datasets/krammnic/hle-multichoice

What is HLE-MultiChoice?

HLE-MultiChoice measures model accuracy on 513 text-only multiple-choice questions from Humanity's Last Exam, testing reasoning capabilities.

Who built HLE-MultiChoice

Led by Artificial Analysis.

    Lineage

    Benchmarks this one is built on and built from: versions, subsets, extensions and the indexes that combine them.

    Built on

    • Humanity's Last Exam original

      “HLE-MultiChoice measures model accuracy on 513 text-only multiple-choice questions from Humanity's Last Exam, testing reasoning capabilities.”

    Tier D

    D

    Long tail: little or no usage data yet.

    How much stands behind a tier: usage, who backs it, a confirmed line from its own site or paper, and a clear read on X. High with three of the four, medium with two, low otherwise.

    • no usage data
    • in curated RL directories (1 pt)
    How we got to tier D
    1. Adoption: no usage data. Tier D.
    2. Not yet read on X.
    3. In curated RL directories: 1 point, a floor of none.
    4. Confirmed: a line from its own site or paper places it.

    A clear view on X moves a tier one step up or down; most entries don't move. How tiers work.

    Where HLE-MultiChoice sits

    Its domain on the map, live. Hover a logo for its name; click to open it. Open it on the full map

    The galaxy could not load. See every vendor on the board.

    Next: browse all benchmarks. Entry from the RL Research daily scrape of public sources, 2026-10-16 snapshot.