AutomationBench A
AI benchmark · Agentic
- Publisher
- Zapier Benchmarks
- Tier
- A why
- Snapshot
What is AutomationBench?
Zapier benchmark for evaluating AI agents on end-to-end business workflow execution across sales, marketing, operations, support, finance, and HR environments.
Tier A
Widely used: a lab reports it, or 50 or more models are scored on it.
How much stands behind a tier: usage, who backs it, a confirmed line from its own site or paper, and a clear read on X. High with three of the four, medium with two, low otherwise.
- 52 models scored
- in curated RL directories (2 pts)
On X · mixed, moderate buzz, from 14 posts about AutomationBench in the last month
Cited in model launches and by Toloka for agent results, but an audit found 206 of 600 public verifiers broken, changing 27.9% of verdicts.
How we got to tier A
- Adoption: 52 models scored. Tier A.
- On X: mixed, moderate buzz. “Cited in model launches and by Toloka for agent results, but an audit found 206 of 600 public verifiers broken, changing 27.9% of verdicts.” No move.
- In curated RL directories: 2 points, a floor of C.
- Not yet confirmed by a line from its own site or paper.
A clear view on X moves a tier one step up or down; most entries don't move. How tiers work.
Not on the map yet: no line from its own site or paper places it in a domain.
Next: browse all benchmarks. Entry from the RL Research daily scrape of public sources, 2026-10-11 snapshot.