SPEARBench D

AI benchmark

Tier
D why
Snapshot

Open benchmark ↗thomasthebaud.github.io/SPEAR-benchmark-website/#welcome

What is SPEARBench?

SPEARBench evaluates the conversational naturalness of streaming speech-to-speech language models across latency, interruptions, speech quality, ASR robustness, dialect consistency, emotion and interpersonal stance.

  • Media mostly

    “We introduce SPEARBench, a benchmark for evaluating naturalness in speech-to-speech language models from question-answer interactions.”
    arxiv.org/abs/2607.05365v1 ↗

Paper: arxiv.org/abs/2607.05365v1 ↗

Tier D

D

Long tail: little or no usage data yet.

How much stands behind a tier: usage, who backs it, a confirmed line from its own site or paper, and a clear read on X. High with three of the four, medium with two, low otherwise.

  • 2 models scored
  • fewer than 5 models scored
  • in curated RL directories (1 pt)
How we got to tier D
  1. Adoption: 2 models scored; fewer than 5 models scored. Tier D.
  2. Not yet read on X.
  3. In curated RL directories: 1 point, a floor of none.
  4. Confirmed: a line from its own site or paper places it.

A clear view on X moves a tier one step up or down; most entries don't move. How tiers work.

Where SPEARBench sits

Its domain on the map, live. Hover a logo for its name; click to open it. Open it on the full map

The galaxy could not load. See every vendor on the board.

Next: browse all benchmarks. Entry from the RL Research daily scrape of public sources, 2026-10-19 snapshot.