Atomic Challenges A

AI benchmark · Cybersecurity

Built by
Irregular
Tier
A why
Snapshot

Open benchmark ↗irregular.com/research/assessing-gpt-6-cyber-against-offensi…

What is Atomic Challenges?

Atomic Challenges is Irregular's suite of 22 short offensive-security challenges measuring model success rates in vulnerability research and exploitation, network attack simulation, and evasion.

Who built Atomic Challenges

Led by Irregular.

    Tier A

    A

    Widely used: a lab reports it, or 50 or more models are scored on it.

    How much stands behind a tier: usage, who backs it, a confirmed line from its own site or paper, and a clear read on X. High with three of the four, medium with two, low otherwise.

    • 2 models scored
    • reported by OpenAI
    • in curated RL directories (1 pt)
    How we got to tier A
    1. Adoption: 2 models scored; reported by OpenAI. Tier A.
    2. On X: unclear, none buzz No move.
    3. In curated RL directories: 1 point, a floor of none.
    4. Confirmed: a line from its own site or paper places it.

    A clear view on X moves a tier one step up or down; most entries don't move. How tiers work.

    Where Atomic Challenges sits

    Its domain on the map, live. Hover a logo for its name; click to open it. Open it on the full map

    The galaxy could not load. See every vendor on the board.

    Next: browse all benchmarks. Entry from the RL Research daily scrape of public sources, 2026-11-16 snapshot.