BioMysteryBench Human-Solvable A

AI benchmark · Science

Built by
Anthropic
Domains
Science
Tier
A why
Snapshot

Open benchmark ↗huggingface.co/datasets/Anthropic/BioMysteryBench-preview

What is BioMysteryBench Human-Solvable?

Measures model accuracy on 76 real-world bioinformatics analysis tasks from BioMysteryBench that at least one human domain expert could solve, averaged over five trials per problem.

Who built BioMysteryBench Human-Solvable

Led by Anthropic.

    Lineage

    Benchmarks this one is built on and built from: versions, subsets, extensions and the indexes that combine them.

    Built on

    • BioMysteryBench full set

    Tier A

    A

    Widely used: a lab reports it, or 50 or more models are scored on it.

    How much stands behind a tier: usage, who backs it, a confirmed line from its own site or paper, and a clear read on X. High with three of the four, medium with two, low otherwise.

    • 14 models scored
    • reported by Anthropic
    • in curated RL directories (1 pt)
    How we got to tier A
    1. Adoption: 14 models scored; reported by Anthropic. Tier A.
    2. On X: unclear, none buzz No move.
    3. In curated RL directories: 1 point, a floor of none.
    4. Confirmed: a line from its own site or paper places it.

    A clear view on X moves a tier one step up or down; most entries don't move. How tiers work.

    Where BioMysteryBench Human-Solvable sits

    Its domain on the map, live. Hover a logo for its name; click to open it. Open it on the full map

    The galaxy could not load. See every vendor on the board.

    Next: browse all benchmarks. Entry from the RL Research daily scrape of public sources, 2026-11-14 snapshot.