Vending-Bench B
AI benchmark · Computer Use
- Domains
- Computer Use Long-Horizon
- Tier
- B why
- Snapshot

What is Vending-Bench?
Vending-Bench measures an LLM agent's long-term coherence by having it run a simulated vending machine business over long horizons, managing inventory, orders, prices and fees.
Enterprise work mostly
“test an LLM-based agent's ability to manage a straightforward, long-running business scenario: operating a vending machine.”
arxiv.org/abs/2502.15840 ↗
Paper: arxiv.org/abs/2502.15840 ↗
Lineage
Benchmarks this one is built on and built from: versions, subsets, extensions and the indexes that combine them.
Derived benchmarks
Vending-Bench 2 later version
Vending-Bench 2 / Vending-Bench Arena later version
Tier B
Established: 15 or more models scored, or curated RL directories rate it.
How much stands behind a tier: usage, who backs it, a confirmed line from its own site or paper, and a clear read on X. High with three of the four, medium with two, low otherwise.
- listed with Andon Labs
- in curated RL directories (2 pts)
- its family includes Vending-Bench 2 (tier A)
On X · well regarded, moderate buzz, from 10 posts about Vending-Bench in the last month
Vending-Bench 2 appears in frontier model launch comparisons and inspires derivative benchmarks, though a few posters mock it or call results bench-maxing.
How we got to tier B
- Adoption: listed with Andon Labs. Tier C.
- On X: well regarded, moderate buzz. “Vending-Bench 2 appears in frontier model launch comparisons and inspires derivative benchmarks, though a few posters mock it or call results bench-maxing.” No move.
- In curated RL directories: 2 points, a floor of C.
- Root of a benchmark family that includes Vending-Bench 2 (tier A): raised to B, one step below.
- Confirmed: a line from its own site or paper places it.
A clear view on X moves a tier one step up or down; most entries don't move. How tiers work.
Where Vending-Bench sits
Its domain on the map, live. Hover a logo for its name; click to open it. Open it on the full map
Next: browse all benchmarks. Entry from the RL Research daily scrape of public sources, 2026-11-14 snapshot.