Cross-Benchmark Transfer from RL on Agentic Coding Tasks - arXiv C

Name: Cross-Benchmark Transfer from RL on Agentic Coding Tasks - arXiv
Creator: Surge AI
Keywords: Enterprise Workflows,Long-Horizon

AI benchmark · Enterprise Workflows

Publisher: Surge AI
Domains: Enterprise Workflows Long-Horizon
On X: @HelloSurgeAI ↗
Tier: C why
Snapshot: October 11, 2026

Open benchmark ↗surgehq.ai/research

Full listing name: Cross-Benchmark Transfer from RL on Agentic Coding Tasks - arXiv:2610.00890

Latest from Surge AI on X

@HelloSurgeAI ↗

An AI agent found every expiring rent discount in a commercial real estate workbook. Then it missed three break clauses representing roughly $14 million in forecast rent. The task required following two different paths through a 15-tab workbook. The model followed one and stopped. Knowing when you’re done is part of the job.
— HelloSurgeAI (@HelloSurgeAI) Oct 9, 2026
Introducing sudo L7: Can Coding Agents Act Like Staff Engineers? Coding agents are getting very good at solving well-defined problems. But staff engineers do much more than write correct code. They understand unfamiliar systems, make architectural decisions, spot risks the ticket never mentioned, and know when passing the tests isn't enough. sudo L7 measures that judgment. Our new software engineering benchmark contains 60 expert-authored tasks, primarily in private production codebases from real companies, complete with legacy code, technical debt, and messy dependencies. We evaluate eight dimensions of engineering behavior, from functional correctness and engineering craft to practical judgment, thought partnership, and knowing when to push back. The best-performing agents score under ~45%. Coding is only part of the job. See you next cycle. Explore sudo L7:
— HelloSurgeAI (@HelloSurgeAI) Oct 8, 2026
Only 2 of 66 runs caught a $25.7M pricing error. One screenshot. One unit mistake. A 100× overstatement. See what else frontier models miss on DAYJOB: Finance:
— HelloSurgeAI (@HelloSurgeAI) Oct 6, 2026

Tier C

Niche: a handful of models scored, or built by an RL vendor.

How much stands behind a tier: usage, who backs it, a confirmed line from its own site or paper, and a clear read on X. High with three of the four, medium with two, low otherwise.

built by Surge AI
no proper name (a paper title or description)
in curated RL directories (2 pts)

How we got to tier C

Adoption: built by Surge AI; no proper name (a paper title or description). Tier D.
Not yet read on X.
In curated RL directories: 2 points, a floor of C. Raised to C.
Not yet confirmed by a line from its own site or paper.

A clear view on X moves a tier one step up or down; most entries don't move. How tiers work.

Not on the map yet: no line from its own site or paper places it in a domain.

More Enterprise Workflows AI benchmarks

Enterprise Workflows RL environments

Next: browse all benchmarks. Entry from the RL Research daily scrape of public sources, 2026-10-11 snapshot.