LiveCodeBench Pro D
AI benchmark · Coding
What is LiveCodeBench Pro?
LiveCodeBench Pro measures LLM performance on continuously updated competitive programming problems from Codeforces, ICPC, and IOI, annotated by Olympiad medalists.
Coding mostly
“We introduce LiveCodeBench Pro, a benchmark composed of problems from Codeforces, ICPC, and IOI that are continuously updated to reduce the likelihood of data contamination.”
arxiv.org/abs/2506.11928 ↗
Paper: arxiv.org/abs/2506.11928 ↗
Lineage
Benchmarks this one is built on and built from: versions, subsets, extensions and the indexes that combine them.
Built on
LiveCodeBench earlier version
Tier D
Long tail: little or no usage data yet.
How much stands behind a tier: usage, who backs it, a confirmed line from its own site or paper, and a clear read on X. High with three of the four, medium with two, low otherwise.
- no usage data
- in curated RL directories (1 pt)
On X · well regarded, low buzz, from 2 posts about LiveCodeBench Pro in the last month
Cited as a hard coding benchmark where progress beat expert forecasts (54% on Hard by May), and praised for fresh problems and failure analysis.
How we got to tier D
- Adoption: no usage data. Tier D.
- On X: well regarded, low buzz. “Cited as a hard coding benchmark where progress beat expert forecasts (54% on Hard by May), and praised for fresh problems and failure analysis.” No move.
- In curated RL directories: 1 point, a floor of none.
- Confirmed: a line from its own site or paper places it.
A clear view on X moves a tier one step up or down; most entries don't move. How tiers work.
Where LiveCodeBench Pro sits
Its domain on the map, live. Hover a logo for its name; click to open it. Open it on the full map
Next: browse all benchmarks. Entry from the RL Research daily scrape of public sources, 2026-11-05 snapshot.