gba-eval-attempts and per-model gba-eval-attempt-* repos C

Name: gba-eval-attempts and per-model gba-eval-attempt-* repos
Creator: Mechanize
Keywords: Coding,Private Codebases

AI benchmark · Coding

Publisher: Mechanize
Domains: Coding Private Codebases
On X: @MechanizeWork ↗
Tier: C why
Snapshot: October 11, 2026

Open benchmark ↗github.com/mechanize-work/gba-eval

Full listing name: gba-eval-attempts and per-model gba-eval-attempt-* repos: published agent codebases with checkpoint histories

Latest from Mechanize on X

@MechanizeWork ↗

Join the most interesting AI data startup. We are hiring more aggressively than ever.
— MechanizeWork (@MechanizeWork) Aug 20, 2026
Dario claims that AI will write basically all code, and that within a year thereafter a large share of software engineering jobs will be lost. While his prediction about the automation of coding is right, the conclusion about jobs does not follow. Coding models are differentially automating coding. But there are many more things that matter, such as making good design decisions and understanding what users want. Progress on these is much slower. As coding is automated, engineering effort is reallocated toward these other things, which raises the overall output of the industry. It also raises the marginal value of the time engineers spend creating software.
— MechanizeWork (@MechanizeWork) Jun 17, 2026
Coding models will often do things that are reasonable during training but produce a terrible user experience. Models trained to conserve tokens will happily rerun 10-minute commands, wasting your time to avoid using a few more tokens.
— MechanizeWork (@MechanizeWork) Jun 17, 2026

What is gba-eval-attempts and per-model gba-eval-attempt-* repos?

GBA Eval measures whether frontier AI coding agents can write a complete GBA emulator with WebAssembly support in 24 hours, graded against Mesen2; the gba-eval-attempts repos publish the resulting emulators and their histories.

Coding mostly
“We give frontier AI coding agents 24 hours to write a complete software GBA emulator with WebAssembly support.”
github.com/mechanize-work/gba-eval ↗

Tier C

Niche: a handful of models scored, or built by an RL vendor.

How much stands behind a tier: usage, who backs it, a confirmed line from its own site or paper, and a clear read on X. High with three of the four, medium with two, low otherwise.

built by Mechanize
in curated RL directories (2 pts)

How we got to tier C

Adoption: built by Mechanize. Tier C.
Not yet read on X.
In curated RL directories: 2 points, a floor of C.
Confirmed: a line from its own site or paper places it.

A clear view on X moves a tier one step up or down; most entries don't move. How tiers work.

Where gba-eval-attempts and per-model gba-eval-attempt-* repos sits

Its realm in the universe, live. Hover a star for its name; click to open it. Open it in the universe

The galaxy could not load. See every vendor on the board.

More Coding AI benchmarks

Coding RL environments

Next: browse all benchmarks. Entry from the RL Research daily scrape of public sources, 2026-10-11 snapshot.