Category

Software Engineering: RL environments and AI benchmarks

AI benchmarks
29
Shares entries with
1 category

Snapshot 2026-10-11. How categories are built · Where the data comes from

The galaxy could not load. See every vendor on the board.

Software Engineering across the universe: its 1 confirmed entry is lit. Hover a star for its name; click to open it.

In short

What are RL environments for software engineering?
A simulated workplace where an AI agent practises a task (a code repository, a browser, business software) and an automatic grader scores each attempt. Labs train on thousands of these attempts. Bought to improve models.
What are the main software engineering benchmarks?
SWE Atlas.

Only benchmarks use the Software Engineering tag: the RL environment directories file their vendors under other categories. Browse all RL environments.

AI benchmarks 29

  1. SWE AtlasPaper Arxiv
28 not yet confirmedListed in the catalog; no line from its own site or paper confirms it yet.
  1. ProgramBench
  2. SWE-Pro
  3. SaaS-Bench
  4. SaaSBench
  5. EvoCode-Bench
  6. LibEvoBench
  7. LiveFMBench
  8. LogDx-CI
  9. MathlibPR
  10. RoadmapBench
  11. SmellBench
  12. SWE-Mutation
  13. VeriContest
  14. Verus-SpecBench
  15. WebGameBench
  16. BUILD-AND-FIND
  17. From Laboratory to Real-World Applications
  18. OmniCode
  19. RepoMirage
  20. SAKE
  21. SWE-Together
  22. MUSE
  23. RigorBench
  24. SCDBench
  25. SWE-Chain
  26. Sphinx
  27. TAAF
  28. Towards Evaluation of Implicit Software World Models in Coding LLMs

Domains that overlap with Software Engineering

Next: pick another domain. Tags come from the RL Research daily scrape, canonicalized nightly.