Domain on the map · as Media

Creative AI benchmarks and RL environments

Creative and aesthetic work, such as images, style and taste, where output is judged by people rather than by an automatic check.

RL environments
3
AI benchmarks
8
Shares entries with
1 category

Snapshot 2026-11-05. How categories are built · Where the data comes from

The galaxy could not load. See every vendor on the board.

Media, live from the universe. Hover a star for its name; click to open it. Open it in the universe

In short

What are RL environments for creative work?
A simulated workplace where an AI agent practises a task (a code repository, a browser, business software) and an automatic grader scores each attempt. Labs train on thousands of these attempts. Bought to improve models. For creative work, that means creative and aesthetic work, such as images, style and taste, where output is judged by people rather than by an automatic check.
Who builds RL environments for creative work?
Taste Labs, Contra Labs and Verita AI.
What are the main creative AI benchmarks?
NeoEvalPlusN, TASTE, IDEAFix, NarrativeWorldBench, QUIET and RP-Bench, among 7 confirmed below.

RL environments 3

  1. Taste Labs
  2. Contra Labs
  3. Verita AI

AI benchmarks 8

  1. NeoEvalPlusNChuckMcSneed
  2. TASTE
  3. IDEAFix
  4. NarrativeWorldBench
  5. QUIET
  6. RP-Bench
  7. Ex Ante Evaluation of AI-Induced Idea Diversity Collapse
1 not yet confirmedListed in the catalog; no line from its own site or paper confirms it yet.
  1. Human Creativity Benchmark

Data 14

  1. Contra Labsbased here
  2. Exabitebased here
  3. Taste Labsbased here
  4. Verita AIbased here
  5. Wirestockbased here
  6. AfterQueryalso covers it
  7. Cuaalso covers it
  8. Markovalso covers it
  9. Refreshalso covers it
  10. Reveloalso covers it
  11. Rise Data Labsalso covers it
  12. Surge AIalso covers it
  13. Symbalalso covers it
  14. Vetto AIalso covers it

Next: pick another domain. Tags come from the RL Research daily scrape, canonicalized nightly.