LibraryDesignBench C

Name: LibraryDesignBench
Creator: Snorkel AI
Keywords: Coding,Computer Use,Enterprise Workflows,Long-Horizon

AI benchmark · Coding

Publisher: Snorkel AI
Domains: Coding Computer Use Enterprise Workflows Long-Horizon
On X: @snorkelai ↗
Tier: C why
Snapshot: October 11, 2026

Open benchmark ↗snorkel.ai/research/

Latest from Snorkel AI on X

@snorkelai ↗

Do agent-built spreadsheets hold up to professional finance standards? MBABench 2.0 checks each answer against an answer key and each workbook against 129 criteria across 12 categories, with the best agent passing only 16% of the tasks. Proud to support @ThomsonYenTY, @hsnamkoong, and the @Columbia_Biz team through Open Benchmarks Grants, and excited to see them launch the benchmark at Frontier Data Summit yesterday.
— snorkelai (@snorkelai) Oct 9, 2026
That's a wrap on Frontier Data Summit! More than 30 speakers and a room full of researchers came together to discuss how we measure and advance frontier AI 🚀
— snorkelai (@snorkelai) Oct 9, 2026
Going live shortly with a bonus session added! 👀 🆕 How benchmarks are and aren’t used in model development today, with @bradenjhancock (@LaudeInstitute) and @dlwh (Marin/Open Athena) Behind the benchmarks: Terminal-Bench Science, JudgmentBench, and SlopCodeBench, with @StevenDillmann, @RussellYang16, @GOrlanski, and @vincentsunnchen
— snorkelai (@snorkelai) Oct 8, 2026

What is LibraryDesignBench?

LibraryDesignBench measures how well coding agents design full-featured software libraries from specifications, scored by the correctness and simplicity of programs downstream user agents write with them.

Coding mostly
“The benchmark spans 242 expert-validated programming problems across 15 library-design tasks in four languages.”
arxiv.org/abs/2609.36730 ↗

Paper: arxiv.org/abs/2609.36730 ↗

Tier C

Niche: a handful of models scored, or built by an RL vendor.

How much stands behind a tier: usage, who backs it, a confirmed line from its own site or paper, and a clear read on X. High with three of the four, medium with two, low otherwise.

built by Snorkel AI
in curated RL directories (2 pts)

How we got to tier C

Adoption: built by Snorkel AI. Tier C.
Not yet read on X.
In curated RL directories: 2 points, a floor of C.
Confirmed: a line from its own site or paper places it.

A clear view on X moves a tier one step up or down; most entries don't move. How tiers work.

Where LibraryDesignBench sits

Its realm in the universe, live. Hover a star for its name; click to open it. Open it in the universe

The galaxy could not load. See every vendor on the board.

More Coding AI benchmarks

Coding RL environments

Next: browse all benchmarks. Entry from the RL Research daily scrape of public sources, 2026-10-11 snapshot.