WildBench A

AI benchmark · Reasoning

Built by
Ai2
Domains
Reasoning
Tier
A why
Snapshot

Open benchmark ↗github.com/allenai/WildBench

What is WildBench?

WildBench evaluates LLMs on about 1,024 challenging real-user tasks, scoring responses with checklist-guided LLM judges (WB-Score and WB-Reward) that correlate with human preferences.

Who built WildBench

Led by Allen Institute for AI (AI2).

    Tier A

    A

    Widely used: a lab reports it, or 50 or more models are scored on it.

    How much stands behind a tier: usage, who backs it, a confirmed line from its own site or paper, and a clear read on X. High with three of the four, medium with two, low otherwise.

    • 61 models scored
    • in curated RL directories (2 pts)

    On X · unclear, low buzz, from 1 post about WildBench in the last month

    Only passing mention in a paper summary on reasoning traces in distilled DeepSeek R1 models; little direct discussion of WildBench itself.

    @burkov ↗

    How we got to tier A
    1. Adoption: 61 models scored. Tier A.
    2. On X: unclear, low buzz. “Only passing mention in a paper summary on reasoning traces in distilled DeepSeek R1 models; little direct discussion of WildBench itself.” No move.
    3. In curated RL directories: 2 points, a floor of C.
    4. Confirmed: a line from its own site or paper places it.

    A clear view on X moves a tier one step up or down; most entries don't move. How tiers work.

    Where WildBench sits

    Its domain on the map, live. Hover a logo for its name; click to open it. Open it on the full map

    The galaxy could not load. See every vendor on the board.

    Next: browse all benchmarks. Entry from the RL Research daily scrape of public sources, 2026-11-14 snapshot.