ShelfLife (measured 2026-08-13): C

Name: ShelfLife (measured 2026-08-13):
Creator: Idler
Keywords: Coding,Enterprise Workflows,Long-Horizon

AI benchmark · Coding

Publisher: Idler
Domains: Coding Enterprise Workflows Long-Horizon
On X: @idler_ai ↗
Tier: C why
Snapshot: October 11, 2026

Open benchmark ↗idler.ai/collections/shelflife

Full listing name: ShelfLife (measured 2026-08-13): https://idler.ai/collections/shelflife

Latest from Idler on X

@idler_ai ↗

We cloned 10 years of sales, inventory, and supplier data from a retail chain into a business simulation. Then, we put frontier AI models in charge for 120 days. Most made less money than a simple greedy algorithm Introducing ShelfLife E-Sim:
— idler_ai (@idler_ai) Aug 27, 2026
Today, we're introducing idler – a frontier data research lab. We've raised a $9M seed round, led by @0xalpo and @FrankieIsLost from @paradigm, with participation from @ycombinator, @LongJourneyVC, and angels including @marrc, @catheryn_li, @dcposch, @JanineLeger, @LynettCapital, @feross, and @nur_daulet_. This funding helps us build the evals, benchmarks, and reinforcement learning environments that the world's leading frontier labs use to train and measure their models.
— idler_ai (@idler_ai) Aug 19, 2026

What is ShelfLife (measured 2026-08-13):?

ShelfLife measures whether agents can act in leadership roles at an e-commerce company, via 200 environments built from a digital twin of the company's operational data.

Enterprise work mostly
“can you deploy an agent in a leadership role within this company, and trust it to execute with appropriate judgment and precision?”
idler.ai/collections/shelflife ↗
Finance
“Numerical finance precisionTasks in this collection tagged “Numerical finance precision” — 141 of them.”
idler.ai/collections/shelflife ↗

Who built ShelfLife (measured 2026-08-13):

Idler built it
“We created a digital twin, ShelfLife, of a live e-commerce company.”
idler.ai/collections/shelflife ↗

Tier C · a leaderboard, listed apart

Niche: a handful of models scored, or built by an RL vendor.

How much stands behind a tier: usage, who backs it, a confirmed line from its own site or paper, and a clear read on X. High with three of the four, medium with two, low otherwise.

built by Idler
in curated RL directories (2 pts)

How we got to tier C

Adoption: built by Idler. Tier C.
Not yet read on X.
In curated RL directories: 2 points, a floor of C.
Confirmed: a line from its own site or paper places it.
Judged a leaderboard, arena or index rather than one benchmark (or not a benchmark at all): listed apart.

A clear view on X moves a tier one step up or down; most entries don't move. How tiers work.

Where ShelfLife (measured 2026-08-13): sits

Its realm in the universe, live. Hover a star for its name; click to open it. Open it in the universe

The galaxy could not load. See every vendor on the board.

More Coding AI benchmarks

Coding RL environments

Next: browse all benchmarks. Entry from the RL Research daily scrape of public sources, 2026-10-11 snapshot.