Directory label
Agentic benchmarks and RL environments
A label other catalogs put on entries, not one of the domains on our map. On the map, each entry here sits in the domain its own site or paper leads with.
Models acting as agents: taking actions in a terminal, browser or tool environment over several turns to reach a goal, rather than answering a single prompt.
- AI benchmarks
- 477
- Shares entries with
- 12 categories
Snapshot 2026-11-05. How categories are built · Where the data comes from
In short
- What are the main agentic benchmarks?
- Terminal-Bench 2.1, Tau2-Bench Telecom, Terminal-Bench 4.0, OSWorld, Terminal-Bench-Science 0.1 and AutomationBench, among 410 confirmed below.
Only benchmarks use the Agentic tag: the RL environment directories file their vendors under other categories. Browse all RL environments.
AI benchmarks 477
-
Terminal-Bench 2.1
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
Tau2-Bench Telecom
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
Terminal-Bench 4.0
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
OSWorld
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
Terminal-Bench-Science 0.1
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
AutomationBench
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
Finance Agent v2
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
AgentBench FC
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
JobBench
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
GDPval
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
E-Bench
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
DRACO
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
AA Briefcase
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
BankerToolBench
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
BFCL v3
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
Finance Agent v1.1
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
ALE-Bench
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
GDPval-AA
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
Gert Labs
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
AndroidWorld
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
MCP Mark Verified
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
PinchBench
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
QwenClawBench
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
Harvey's Legal Agent Benchmark
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
Vending-Bench 2
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
Tau3-Banking
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
Berkeley Function-Calling Leaderboard
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
ClawEval-MM
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
Gert Labs Rankings
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
RuneBench
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
AgentDrive
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
Gaia2
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
MCPMark-Verified
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
ProfBench
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
SearchAgent Leaderboard
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
Vals.ai Financial Agent 1.1
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
Terminal-Bench-Science
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
Long-Horizon Terminal-Bench
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
GDP.pdf
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
Toolathlon
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
AutomationBench-AA
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
τ-bench
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
PostTrainBench
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
DABstep
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
t2-bench
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
TRAP
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
CyberGym
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
DeepSearchQA
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
Claw-Eval
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
DeepPlanning
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
CyberBench
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
APEX-Agents-AA
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
SWE-Atlas Refactoring
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
ResearchClawBench
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
VITA-Bench
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
AgentFloor
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
AMA-Bench
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
AutoBench
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
BabyAI
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
CHI-Bench
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
ClawBench
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
ClawProBench
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
ContextEcho
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
ContractBench
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
CorpBench Work 1.3
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
Data Agent Benchmark
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
Deep20Bench
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
DeepResearchEval
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
Dr-CiK
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
Hindsight LLM Memory Leaderboard
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
MCP-Universe
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
MCP-Bench
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
MCPMark
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
METR Task-Completion Time Horizons 1.1
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
NanoGPT Speedrun Frontier
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
AgentWorldBench
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
RuVerBench
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
Vals CyberBench
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
VitaBench
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
WildClawBench
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
WolfBench
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
Workspace-Bench
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
Agent Island
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
AgentCIBench
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
Agentic Skills Evaluation Framework
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
AsyncTool
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
Benchmarks are Not Enough
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
Claw Bench
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
Clembench Text v3.0
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
Online Mind2Web
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
Hunt Instead of Wait
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
ITBench-AA
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
Ko-WideSearch
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
LLM-WikiRace
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
M3MAD-Bench
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
MINTEval
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
OmniGAIA
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
OR-Space
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
PersonaArena
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
POLAR-Bench
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
ProactBench
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
RankJudge
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
RIFT-Bench: Dynamic Red-teaming For Agentic AI Systems
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
ScreenSpot
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
STALE
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
STT-Arena
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
Tau2 Airline
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
TAU3-Bench
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
TIDE
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
Trip+
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
UAVBench
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
Poker Agent
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
VerdictBench
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
VitaBench 2.0
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
WebArena
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
TAU-bench Airline
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
MultiMedia-TerminalBench
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
OSWorld-MCP
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
EnterpriseBench
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
Frontier-Bench
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
Cybench
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
ExploitGym
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
EdgeBench
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
ExploitBench
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
WebVoyager
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
ZClawBench
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
SWE-sweep
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
InferenceBench
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
MobileWorld
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
GAIA
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
Time Horizon Index: KSP
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
SRE Bench
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
Public Benefits Bench v1
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
DeepResearch Bench II
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
AcademiClaw: When Students Set Challenges for AI Agents
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
AgencyBench
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
AgentBoard
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
AgentHijack
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
Agentick
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
AgingBench
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
AI Snitches Get Glitches
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
AIM-Bench
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
Ambig-DS
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
Android Control High_EM
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
Android Control Low_EM
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
Benchmarking Autonomous Agents against Temporal
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
Beyond the All-in-One Agent
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
Biopharma Bench
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
BioSecBench-Surveillance
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
Boiling the Frog
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
CalBench
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
CEO-Bench: Can Agents Play the Long Game?
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
ChildAgentEval
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
ClawForge
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
Composite-Bench
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
CooperBench
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
CRMArena
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
DEEPSYNTH
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
Do Coding Agents Understand Least-Privilege Authorization?
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
DR-Arena
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
Drift-Bench
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
Founder Bench
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
ERP-Bench
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
EVA-Bench
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
FrontierChallenge
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
GPTNT
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
Hack-Verifiable TextArena
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
Hex DataBench
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
ITSMBench
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
MiniWoB++
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
MLAgentBench
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
OdysseyBench
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
SpeedrunBench: SuperTux 1-1
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
TAU2-bench Retail
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
TerminalWorld
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
WebLINX
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
WebWorld-Bench
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
WorkArena-L1
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
WorkArena-L2
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
1GC-7RC
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
ADBench
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
AgentRewardBench
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
AgentEvalBench
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
AgentMeter
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
AgentTrap
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
AGORA
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
AITZ_EM
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
ALFWorld
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
ATRBench
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
Bosses
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
CAR-bench
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
ChronosBench
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
Claw-Anything
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
Claw-Eval-Live
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
DecisionBench
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
DeepResearch Bench
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
DisasterBench
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
DMV-Bench
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
DPBench
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
EComAgentBench
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
EgoBench
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
EnterpriseClawBench
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
EnvSimBench
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
EnvTrustBench
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
EvoEnv
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
EvoMemBench
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
FounderBench
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
GateMem
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
GroupMemBench
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
GroupTravelBench
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
GUI vs. CLI
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
ScienceAgentBench
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
Harness-Bench
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
InterLV-Search
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
JourneyBench
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
KramaBench
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
LLM Game Benchmark
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
Managing Procedural Memory in LLM Agents
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
MASBENCH
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
MEME: Multi-entity & Evolving Memory Evaluation
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
MemEye
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
MEMPROBE
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
MemTrace
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
Momento
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
MOSAIC-Bench
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
Mr Dre
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
MultiSessionCollab
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
MyPCBench
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
Omni-DeepSearch
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
OmniACT
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
OpenClaw Arena Model Leaderboard
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
OpenComputer
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
OpenSkillEval
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
OverEager-Gen / OverEager-Bench
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
P2PCLAW Innovative Benchmark
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
Parallel WebBench
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
Partial Evidence Bench
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
PiSAR
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
PlanBench-XL
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
PolitNuggets
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
PostEDA-Bench
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
PrivacyPeek
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
RealDataAgentBench
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
RecoAtlas
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
ScholarQuest
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
SearchGEO
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
SGR-Bench
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
SkillEvolBench
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
SkillGenBench
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
SLDBench
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
SmartHome-Bench
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
SocialMemBench
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
SocialPersona
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
SREGym
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
TeamBench
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
TERMS-Bench
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
The Agent Company
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
Time to REFLECT
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
Timely-Eval
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
TimeSage-MT
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
ToolAlpaca
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
ToolQA
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
TRIP-Bench
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
VeriTrip
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
VisualWebArena
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
WebGym
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
When Safe Skills Collide
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
When Search Agents Should Ask
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
Wiki Live Challenge
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
WildAgtEval
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
WorldMemArena
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
BrowseComp-VL
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
OSWorld 2.1
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
OSWorld 2.1 Offline
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
TAU-bench
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
Tax Agent Bench
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
BrowseComp Extended
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
Terminal-Bench 2.1 Extended
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
Adversarial Customer Service
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
HANDBOOK.md
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
Hermes Index
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
Vals Science Index
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
FACTS Search V2
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
TRIAGE
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
EQ-Bench 4
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
AA-AnalystAgent
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
CTI-REALM
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
AI4AI-Bench
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
ApprenticeBench
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
DiG-bench
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
LiveClaw
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
When2Call Multi-Turn
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
RelyToolBench
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
ExplorationBench AlienLogic
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
MCP-Atlas claim coverage
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
LAB all-pass
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
LAB criterion-pass
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
Toolathlon Verified avg. turns
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
Design Arena Agentic Web Dev
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
Harvey LAB-AA v1.1
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
Harvey LAB-AA v1.1 Criterion Pass
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
AA Tau3 Banking
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
AA Cyber Index
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
CWE-Bench-AA
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
DeepsecBench-AA
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
CyberGym-E2E-AA
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
b3 Agent Security
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
Cyber Misuse Refusal
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
Toolathlon-Verified
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
Harvey Legal Agent
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
Kimi Hallu Bench Hard
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
τ²-bench results
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
τ²-bench Airline
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
OpenHands Index
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
SWE Refactor Bench
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
MM-ClawBench
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
QwenWebBench
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
CoWorkBench
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
ReviewBench
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
Ramp Accounting Bench
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
Visual Tool Bench
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
SciUniverse Level 1
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
Parallel Search Capability
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
Vals Router Index
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
Vals Legal Index
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
Vals Inference Provider Index
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
Vals Finance Index
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
xdev-bench-hard
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
The Last Ones completion
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
SEC-Bench Pro
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
CyScenarioBench solved
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
Atomic network attacks
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
SCONE simulated revenue
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
Anthropic OSS-Fuzz crash
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
Anthropic OSS-Fuzz write primitive
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
CVE-Bench zero-day
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
RuneScape-Bench
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
Agent Poker Bench
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
Public Benefits Bench v1.1
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
MysteryMechanism
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
GDPval Extended
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
Harvey LAB
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
AgentCARD
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
AgentKernelArena
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
AgentOdyssey
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
AgentQuest
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
AIRS-Bench
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
APEX-v1-extended
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
AppWorld
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
AssistantBench
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
ASTA Bench
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
AutoLab
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
CAIA Benchmark
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
Can LLM Agents Respond to Disasters? Benchmarking Heterogeneous Geospatial Reasoning in Emergency Operations
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
ChainWorld
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
DigiWorld
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
Do Agents Know What They Can't Do? Evaluating Feasibility Awareness in Tool-Using Agents
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
Do Enterprise Systems Need Learned World Models? The Importance of Context to Infer Dynamics
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
EngiAI
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
ENPMR-Bench
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
EnterpriseRAG-Bench
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
Executable Benchmarking Suite for Tool-Using Agents
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
Health Memory Arena
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
LMArena Search Arena
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
MineDojo
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
ResearchGym
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
RSIBench-Data
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
SEATauBench
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
TravelPlanner
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
VAKRA
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
WANDR
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
WebChoreArena
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
WebShop
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
WorkArena-L3
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
AgentCollabBench
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
AgentEscapeBench
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
CausaLab
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
CFAgentBench
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
DedeuceBench
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
Deep Research Agent Benchmark
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
DeepResearch Bench Multilingual
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
Exploring Autonomous Agentic Data Engineering for Model Specialization
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
FIRE-Bench
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
From Task Solving to Robust Real-World Adaptation in LLM Agents
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
GISA
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
InteractiveBench Overall
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
LongMemEval-V2
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
MDGYM
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
Memory-Induced Tool-Drift in LLM Agents
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
Memory Retention Is Not Enough to Master Memory Tasks in Reinforcement Learning
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
Mind2Web
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
MM-Mind2Web
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
MobileMiniWob++_SR
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
MUTATE
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
NanoGPT-Bench
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
Nexus Function Calling
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
OfficeBench
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
OMLAB Open Agent Math Leaderboard
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
OpenClaw Arena Config Leaderboard
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
OSUniverse
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
PerMemBench
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
Push Your Agent
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
SEAGym
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
StableToolBench
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
T2QBench
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
Tau2 Average
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
Towards Direct Evaluation of Harness Optimizers via Priority Ranking
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
WebTailBench
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
Whose Side Is Your Agent On? Multi-Party Principal Loyalty in LLM Agents
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
-
Workspace-Bench 1.0
No line from its own site or paper places it in Agentic yet; the catalog lists it here.
67 not yet confirmedListed in the catalog; no line from its own site or paper confirms it yet.
- HLE w/ tools
- WebArena-Verified
- BioMysteryBench
- LOCA-Bench 256K
- GDPval rubrics
- MazeBench
- EnterpriseOps-Gym
- ToolSandbox
- RedlineBench
- Clembench Multimodal v1.6.5
- PlanAhead
- BrowseComp+
- Robo-bench
- Finch
- Frontier Finance
- A Matter of TASTE
- Compositional Skill Routing for LLM Agents
- Endless Terminals
- Grounding Agent Memory in Contextual Intent
- Helicase
- HyperEyes
- MemDelta
- PhotoFlow: Agentic 3D Virtual Photography Missions
- Vals Terminal-Bench 1.0 mirror
- EMB
- Finance Agent v2.1
- EMB v1.1
- Voyager Minecraft
- Hermes Bench
- DECK-Bench
- Financial Modeling
- ExplorationBench AlienCode
- Toolathlon Verified Pass@3
- Toolathlon Verified Pass³
- AA AutomationBench
- AA EnterpriseOps-Gym
- AA Harvey LAB v1.0
- AA ITBench
- AA Agentic Index
- LifeVal
- Kimi Claw 24/7
- Business Operation
- Financial Research
- DECK-Arena
- Design Bench
- MLE-Bench Lite
- MCP-Tasks
- WideResearch
- MEWC
- ACE solved
- The Last Ones steps
- FrontierCyber
- CyScenarioBench success
- Atomic vulnerability research
- Atomic evasion
- SCONE post-cutoff success
- Firefox 147 exploits
- Harvey's Legal Agent Benchmark v1
- FACTS Search V1
- Beyond Global Replanning
- Galileo Agent Leaderboard
- OS-Copilot
- Sandboxed Coding Agents are Competitive Omni-modal Task Solvers
- TemporalBench
- Tools as Continuous Flow for Evolving Agentic Reasoning
- Uncertainty Decomposition for Clarification Seeking in LLM Agents
- VisualClaw
Next: pick another domain. Tags come from the RL Research daily scrape, canonicalized nightly.