SWE Atlas: Codebase QnA, Test Writing, Refactoring B

AI benchmark · Coding

Publisher
Scale AI
On X
@scale_ai ↗
Tier
B why
Snapshot

Open benchmark ↗labs.scale.com/papers

Full listing name: SWE Atlas: Codebase QnA, Test Writing, Refactoring (2026-05-07)

Latest from Scale AI on X

@scale_ai ↗

What is SWE Atlas: Codebase QnA, Test Writing, Refactoring?

SWE Atlas benchmarks coding agents on software engineering tasks beyond issue resolution.

Tier B · a leaderboard, listed apart

B

Established: 15 or more models scored, or curated RL directories rate it.

How much stands behind a tier: usage, who backs it, a confirmed line from its own site or paper, and a clear read on X. High with three of the four, medium with two, low otherwise.

  • 14 models scored
  • built by Scale AI
  • in curated RL directories (3 pts)
How we got to tier B
  1. Adoption: 14 models scored; built by Scale AI. Tier C.
  2. Not yet read on X.
  3. In curated RL directories: 3 points, a floor of B. Raised to B.
  4. Confirmed: a line from its own site or paper places it.
  5. Judged a leaderboard, arena or index rather than one benchmark (or not a benchmark at all): listed apart.

A clear view on X moves a tier one step up or down; most entries don't move. How tiers work.

Where SWE Atlas: Codebase QnA, Test Writing, Refactoring sits

Its realm in the universe, live. Hover a star for its name; click to open it. Open it in the universe

The galaxy could not load. See every vendor on the board.

Next: browse all benchmarks. Entry from the RL Research daily scrape of public sources, 2026-10-11 snapshot.