Creative Writing v3 A

AI benchmark · Writing

Domains
Writing
Tier
A why
Snapshot

What is Creative Writing v3?

EQ-Bench Creative Writing v3 is an LLM-judged creative writing benchmark that evaluates models across 32 writing prompts with 3 iterations per prompt. Uses a hybrid scoring system combining rubric assessment and Elo ratings through pairwise comparisons. Challenges models in areas like humor, romance, spatial awareness, and unique perspectives to assess emotional intelligence and creative writing capabilities.

Tier A

A

Widely used: a lab reports it, or 50 or more models are scored on it.

How much stands behind a tier: usage, who backs it, a confirmed line from its own site or paper, and a clear read on X. High with three of the four, medium with two, low otherwise.

  • 111 models scored
  • in curated RL directories (1 pt)

On X · unclear, low buzz, from 1 post about Creative Writing v3 in the last month

Only one low-engagement post mentions it, citing its Elo scoreboard in passing to compare Claude and GPT creative writing.

@BretKerr ↗

How we got to tier A
  1. Adoption: 111 models scored. Tier A.
  2. On X: unclear, low buzz. “Only one low-engagement post mentions it, citing its Elo scoreboard in passing to compare Claude and GPT creative writing.” No move.
  3. In curated RL directories: 1 point, a floor of none.
  4. Not yet confirmed by a line from its own site or paper.

A clear view on X moves a tier one step up or down; most entries don't move. How tiers work.

Not on the map yet: no line from its own site or paper places it in a domain.

Next: browse all benchmarks. Entry from the RL Research daily scrape of public sources, 2026-10-11 snapshot.