Domain on the map · as Coding

Software Engineering: AI benchmarks

AI benchmarks
28
Shares entries with
1 category

Snapshot 2026-11-12. How categories are built · Where the data comes from

The galaxy could not load. See every vendor on the board.

Coding, live from the universe. Hover a star for its name; click to open it. Open it in the universe

In short

What are the main software engineering benchmarks?
APEX-SWE, SaaS-Bench, SaaSBench, EvoCode-Bench, From Laboratory to Real-World Applications and SWE-Together, among 26 confirmed below.

Only benchmarks use the Software Engineering tag: the RL environment directories file their vendors under other categories. Browse all RL environments.

AI benchmarks 28

  1. APEX-SWE
  2. SaaS-BenchUniPat AI
  3. SaaSBenchUniPat AI
  4. EvoCode-Bench
  5. From Laboratory to Real-World Applications
  6. SWE-Together
  7. BUILD-AND-FIND
  8. LibEvoBench
  9. LiveFMBench
  10. LogDx-CI
  11. MathlibPR
  12. OmniCodeseal-research, Saikat Dutta et al, Kevin Ellis, Cornell authors Atharv Sonwane
  13. RepoMirage
  14. RoadmapBench
  15. SAKE
  16. SmellBench
  17. SWE-Mutation
  18. VeriContest
  19. Verus-SpecBench
  20. WebGameBench
  21. RigorBench
  22. SCDBench
  23. Sphinx
  24. SWE Atlas
  25. SWE-Chain
  26. Towards Evaluation of Implicit Software World Models in Coding LLMsJetBrains Research
2 not yet confirmedListed in the catalog; no line from its own site or paper confirms it yet.
  1. SWE-Pro
  2. TAAF

Data 29

  1. Avirobased here
  2. Bespoke Labsbased here
  3. Datacurvebased here
  4. Emulatedbased here
  5. General Reasoningbased here
  6. Parsewavebased here
  7. pre.devbased here
  8. Revelobased here
  9. Abundantalso covers it
  10. AfterQueryalso covers it
  11. Anthromindalso covers it
  12. Collinearalso covers it
  13. Contra Labsalso covers it
  14. Handshakealso covers it
  15. HUDalso covers it
  16. Huzzle Labsalso covers it
  17. Mercoralso covers it
  18. micro1also covers it
  19. Patronus AIalso covers it
  20. ReasonCorealso covers it
  21. Refreshalso covers it
  22. Rise Data Labsalso covers it
  23. Snorkel AIalso covers it
  24. Surge AIalso covers it
  25. Thetaalso covers it
  26. Trajectory Labsalso covers it
  27. Turingalso covers it
  28. Verita AIalso covers it
  29. Vetto AIalso covers it

Next: pick another domain. Tags come from the RL Research daily scrape, canonicalized nightly.