SWE-Arena D

AI benchmark · Coding

Publisher
SWE Arena HF Json
Domains
Coding
Tier
D why
Snapshot

What is SWE-Arena?

Arena-style leaderboard for software-engineering agents, reporting Elo, win rate, conversation efficiency, consistency, and graph-derived ranking metrics.

Tier D · a leaderboard, listed apart

D

Long tail: little or no usage data yet.

How much stands behind a tier: usage, who backs it, a confirmed line from its own site or paper, and a clear read on X. High with three of the four, medium with two, low otherwise.

  • 1 models scored
  • fewer than 5 models scored
  • in curated RL directories (1 pt)
How we got to tier D
  1. Adoption: 1 models scored; fewer than 5 models scored. Tier D.
  2. Not yet read on X.
  3. In curated RL directories: 1 point, a floor of none.
  4. Not yet confirmed by a line from its own site or paper.
  5. Judged a leaderboard, arena or index rather than one benchmark (or not a benchmark at all): listed apart.

A clear view on X moves a tier one step up or down; most entries don't move. How tiers work.

Not on the map yet: no line from its own site or paper places it in a domain.

Next: browse all benchmarks. Entry from the RL Research daily scrape of public sources, 2026-10-11 snapshot.