Directory label
Tool-use benchmarks for LLMs and tool-use environments
A label other catalogs put on entries, not one of the domains on our map. On the map, each entry here sits in the domain its own site or paper leads with.
Calling external tools and APIs correctly: choosing the right function, passing valid arguments and using the results to finish a task.
- RL environments
- 3
- AI benchmarks
- 27
- Shares entries with
- 3 categories
Snapshot 2026-11-05. How categories are built · Where the data comes from
In short
- What are RL environments for tool use?
- A simulated workplace where an AI agent practises a task (a code repository, a browser, business software) and an automatic grader scores each attempt. Labs train on thousands of these attempts. Bought to improve models. For tool use, that means calling external tools and APIs correctly: choosing the right function, passing valid arguments and using the results to finish a task.
- Who builds RL environments for tool use?
- Chakra Labs, Pareto and Markov.
- What are the main tool-use benchmarks?
- BFCL-V4, BFCL_v3_MultiTurn, Leap, Attune, AutoCAD-Bench and TRACE, among 23 confirmed below.
RL environments 3
-
Chakra Labs
Sells RL environments“Deterministic, pixel-perfect reinforcement learning environments with frame-accurate state control” source ↗
-
Pareto
No line from its own site or paper places it in Tool Use yet; the catalog lists it here.
-
Markov
Sells RL environments“End-to-end CAD environments with the full prompt, reference inputs, complete screen recording, deliverable previews, and step-level action trajectories.” source ↗
AI benchmarks 27
-
BFCL-V4
No line from its own site or paper places it in Tool Use yet; the catalog lists it here.
-
BFCL_v3_MultiTurn
No line from its own site or paper places it in Tool Use yet; the catalog lists it here.
-
Leap
Pareto · built it“we built LEAPBench (Learning Efficiency in Adaptive Processes): a benchmark intentionally designed to measure the in-context learning efficiency of LLMs” source ↗
-
Attune
Pareto · built it with others“This work was a collaboration between Pareto AI’s Research team, led by Mark Whiting, and Thoughtful Lab, led by Karina Nguyen.” source ↗
-
AutoCAD-Bench
No line from its own site or paper places it in Tool Use yet; the catalog lists it here.
-
TRACE
No line from its own site or paper places it in Tool Use yet; the catalog lists it here.
-
ComplexMCP
No line from its own site or paper places it in Tool Use yet; the catalog lists it here.
-
ACEBench
No line from its own site or paper places it in Tool Use yet; the catalog lists it here.
-
ComplexFuncBench
No line from its own site or paper places it in Tool Use yet; the catalog lists it here.
-
TOBench
No line from its own site or paper places it in Tool Use yet; the catalog lists it here.
-
Trust No Tool
No line from its own site or paper places it in Tool Use yet; the catalog lists it here.
-
When Simulation Lies
No line from its own site or paper places it in Tool Use yet; the catalog lists it here.
-
BFCL v2
No line from its own site or paper places it in Tool Use yet; the catalog lists it here.
-
API-Bank
No line from its own site or paper places it in Tool Use yet; the catalog lists it here.
-
AWARE-US
No line from its own site or paper places it in Tool Use yet; the catalog lists it here.
-
Beyond Function Calling
No line from its own site or paper places it in Tool Use yet; the catalog lists it here.
-
Gorilla Benchmark API Bench
No line from its own site or paper places it in Tool Use yet; the catalog lists it here.
-
MANTRA
No line from its own site or paper places it in Tool Use yet; the catalog lists it here.
-
MAVEN-Bench
No line from its own site or paper places it in Tool Use yet; the catalog lists it here.
-
TIDE-Bench
No line from its own site or paper places it in Tool Use yet; the catalog lists it here.
-
Time Puzzles
No line from its own site or paper places it in Tool Use yet; the catalog lists it here.
-
ToolPrivacyBench
No line from its own site or paper places it in Tool Use yet; the catalog lists it here.
-
LLM Agents Already Know When to Call Tools -- Even Without Reasoning
No line from its own site or paper places it in Tool Use yet; the catalog lists it here.
4 not yet confirmedListed in the catalog; no line from its own site or paper confirms it yet.
Next: pick another domain. Tags come from the RL Research daily scrape, canonicalized nightly.