Measuring Autonomous AI Research C

Name: Measuring Autonomous AI Research
Creator: Prime Intellect
Keywords: Coding,Enterprise Workflows,Long-Horizon,Math

AI benchmark · Coding

Publisher: Prime Intellect
Domains: Coding Enterprise Workflows Long-Horizon Math
On X: @PrimeIntellect ↗
Tier: C why
Snapshot: October 11, 2026

Open benchmark ↗primeintellect.ai/blog/measuring-autonomous-research

Full listing name: Measuring Autonomous AI Research / NanoGPT speedrun benchmark

Latest from Prime Intellect on X

@PrimeIntellect ↗

Over two weeks, Prime Agent orchestrated a swarm of over 2,000 agents to rewrite itself in Rust. With 10,000+ sandboxes, 200B+ GLM-5.3 tokens, and 16,000 agent-to-agent messages, this was our largest test yet of Prime Agent’s multi-agent capabilities and our infrastructure powering these agent swarms. Prime Agent now reaches usable input ~13× faster and uses 83% less startup memory than before.
— PrimeIntellect (@PrimeIntellect) Oct 9, 2026
Inference scaling works, but every agent eventually faces the same problem: its context window fills up. In this essay, we argue the only scalable fix leads straight to swarms.
— PrimeIntellect (@PrimeIntellect) Oct 9, 2026
Open superintelligence accelerates open scientific research. The Alzheimer’s Translation Challenge will share a 150M cell atlas on the Alzehimer's Disease workbench and Prima Mente's modeling platform. Prime Intellect is lending infrastructure support to researchers to build models based on this dataset. The best hypotheses will be tested in Prima Mente's wet lab.
— PrimeIntellect (@PrimeIntellect) Oct 8, 2026

What is Measuring Autonomous AI Research?

Measures how well frontier models can autonomously conduct AI research by running multi-day agent runs on the nanoGPT optimizer speedrun and scoring the share of the human record gap closed.

Coding
“we ran 153 autonomous runs on the nanoGPT optimizer speedrun across 18 frontier models, testing multiple seeds per model.”
primeintellect.ai/blog/measuring-autonomous-research ↗
Science mostly
“We want to measure how well frontier models can conduct research.”
primeintellect.ai/blog/measuring-autonomous-research ↗

Tier C

Niche: a handful of models scored, or built by an RL vendor.

How much stands behind a tier: usage, who backs it, a confirmed line from its own site or paper, and a clear read on X. High with three of the four, medium with two, low otherwise.

built by Prime Intellect
in curated RL directories (2 pts)

How we got to tier C

Adoption: built by Prime Intellect. Tier C.
Not yet read on X.
In curated RL directories: 2 points, a floor of C.
Confirmed: a line from its own site or paper places it.

A clear view on X moves a tier one step up or down; most entries don't move. How tiers work.

Where Measuring Autonomous AI Research sits

Its realm in the universe, live. Hover a star for its name; click to open it. Open it in the universe

The galaxy could not load. See every vendor on the board.

More Coding AI benchmarks

Coding RL environments

Next: browse all benchmarks. Entry from the RL Research daily scrape of public sources, 2026-10-11 snapshot.