Diplomacy Arena leaderboard C
AI benchmark · Long-Horizon
- Publisher
- Good Start Labs
- Domains
- Long-Horizon
- On X
- @goodstartlabs ↗
- Tier
- C why
- Snapshot
Latest from Good Start Labs on X
@goodstartlabs ↗What is Diplomacy Arena leaderboard?
Diplomacy Arena scores models on multi-agent strategic negotiation by having each play 20 games of AI Diplomacy against a weak opponent, rewarding supply centers captured and speed, plus betrayal tendency and steerability.
Games mostly
“The overall performance score is calculated by having each model play 20 games of AI Diplomacy against a weak opponent (Mistral: Devstral Small 1.1).”
goodstartlabs.com/benchmarks/diplomacy ↗
Who built Diplomacy Arena leaderboard
Good Start Labs built it
“We created the first Diplomacy environment where even small models can play full games.”
goodstartlabs.com/research ↗
Tier C
Niche: a handful of models scored, or built by an RL vendor.
How much stands behind a tier: usage, who backs it, a confirmed line from its own site or paper, and a clear read on X. High with three of the four, medium with two, low otherwise.
- built by Good Start Labs
- in curated RL directories (2 pts)
How we got to tier C
- Adoption: built by Good Start Labs. Tier C.
- Not yet read on X.
- In curated RL directories: 2 points, a floor of C.
- Confirmed: a line from its own site or paper places it.
A clear view on X moves a tier one step up or down; most entries don't move. How tiers work.
Where Diplomacy Arena leaderboard sits
Its realm in the universe, live. Hover a star for its name; click to open it. Open it in the universe
Next: browse all benchmarks. Entry from the RL Research daily scrape of public sources, 2026-10-11 snapshot.