GDP.xlsx

An AI agent found every expiring rent discount in a commercial real estate workbook. Then it missed three break clauses representing roughly $14 million in forecast rent. The task required following two different paths through a 15-tab workbook. The model followed one and stopped. Knowing when you’re done is part of the job.

— HelloSurgeAI (@HelloSurgeAI) Oct 9, 2026

Introducing sudo L7: Can Coding Agents Act Like Staff Engineers? Coding agents are getting very good at solving well-defined problems. But staff engineers do much more than write correct code. They understand unfamiliar systems, make architectural decisions, spot risks the ticket never mentioned, and know when passing the tests isn't enough. sudo L7 measures that judgment. Our new software engineering benchmark contains 60 expert-authored tasks, primarily in private production codebases from real companies, complete with legacy code, technical debt, and messy dependencies. We evaluate eight dimensions of engineering behavior, from functional correctness and engineering craft to practical judgment, thought partnership, and knowing when to push back. The best-performing agents score under ~45%. Coding is only part of the job. See you next cycle. Explore sudo L7:

— HelloSurgeAI (@HelloSurgeAI) Oct 8, 2026

Only 2 of 66 runs caught a $25.7M pricing error. One screenshot. One unit mistake. A 100× overstatement. See what else frontier models miss on DAYJOB: Finance:

— HelloSurgeAI (@HelloSurgeAI) Oct 6, 2026