Laya vs Jev: Did Decision AI Arrive a Year Earlier?
Laya's creator published related research before Jev, but the public evidence establishes a precursor rather than an identical system.
Research and Analysis
Original data and analysis on the RL environment economy: vendors, benchmarks, environment craft, and the infrastructure underneath, from the RL Research team.
Meet the authors →By Spark Benioff
Is TypeSafe's Jev an LLM? What changes for RL environments
Jev can select bounded actions in RL environments; tasks that require writing still need a generative model.
Anthropic's AI agents beat 28 human experts at alignment research, and humans became the baseline
Automation has reached the loop's last human stage: expert researchers now serve as the measured baseline, and the human role narrows to defining failures and judging what counts as better.
1,700 RL tasks lifted Kimi K2.7 on every coding benchmark tested
Broad expert task portfolios, not benchmark targeting, are now the reliable training recipe: one 1,700-task set lifted five external coding benchmarks at once and made the agent faster as well as stronger.
AI agents solved a Millennium Prize problem. A mathematician says they raced him to it
When a lab can point 10,000 agents at one problem, unpublished expert work becomes training input, and provenance becomes the priced feature of expert data.
An Anthropic researcher resigned over self-improving AI: human grading is the one loop stage that does not scale
The self-improvement race the resignation describes runs on a supply chain of RL environments and verifiers, and human grading is the only stage of the loop that does not scale with compute.
AI agents learned to hedge. The benchmark patched it and published the cost
When agents learn to game a benchmark, the fix is recalibrating the judge, and mature vendors now publish what that recalibration costs.
RL environments just moved a 397B model. The training guide is public
Expert-built RL environments moved a 397B open-weight model by 70 percent relative on held-out professional tasks, and the recipe is published rather than proprietary.
How stable are AI leaderboards? One refresh moved 135 model scores
Composite AI leaderboard scores behave like instruments that get recalibrated, so most single-day movement says more about the ruler than about the models.
Who defines ground truth for AI agents?
Human experts define ground truth for AI agents: authors create private truth, reviewers adjudicate it, and models never approve it. Trusted environments publish their calibration thresholds.
Why AI agent sandboxes run in microVMs with zero inbound ports
Long-horizon episodes need the operating system and applications the work runs on, plus hard isolation; the pattern the reference spec adopts is microVMs with zero inbound ports.
How AI agents cheat their training environments
Under RL pressure agents game environments in predictable ways, from format masquerading as competence to memorization of leaked test structure. The counters are integrity gates that run first and carry zero reward weight.
Training AI on office work made it better at coding
Environment training transfers across domains. A model post-trained on office tasks with no coding in the mix gained 5.8 points on SWE-Bench Pro, which changes what labs are buying.
Mercor's APEX-Accounting benchmark measures month-end close and leaves audit out of scope
Mercor and Ramp's APEX-Accounting is a benchmark for month-end close and bookkeeping. Audit is outside its scope by Mercor's own note, and audit work is graded on evidence integrity, which no reconciliation benchmark carries.
A production-grade RL environment spec freezes state, reward, and splits before code
Tracked environments rarely publish verifier calibration or a frozen corpus; a production-grade spec fixes state machine, reward, and splits in a contract before any code.
Which jobs can become RL environments?
Jobs whose core work happens on a computer and produces a checkable output can become RL environments; jobs with a critical physical dependency cannot, at any budget.
Why Mercor is buying Deeptune
Mercor's Deeptune acquisition says the constraint has shifted from expert networks to the environments themselves. The vendor data shows the gap the deal targets.
3,029 AI benchmarks, 99 RL environments: the field is over-indexed on evaluation
The benchmark pile keeps growing while cataloged RL environments are rare: 99 against 3,029 benchmarks. Expert verification, not benchmark count, moves the numbers.
AI benchmarks cover only 3.5% of real work
Joining 202 O*NET occupational tasks against 223 benchmarks with an LLM judge yields definitive coverage of 3.5%. Benchmark success overstates workflow competence.
What do AI expert job postings reveal about RL environment demand?
Marketplace listings are a leading indicator: labs recruit experts months before the environments those experts build reach training runs.
The RL environment industry is 38 companies, mostly under 50 people
A cottage industry of mostly sub-50-person vendors supplies the most capitalized labs on earth.
Why RL environment vendors earn services margins and software valuations
Frontier labs are shifting spend from labeled data to executable environments, and vendor margins show the leverage sits in verification rather than labor.