CharXiv-R B

AI benchmark · Multimodal

Tier
B why
Snapshot

What is CharXiv-R?

CharXiv-R is the reasoning component of the CharXiv benchmark, focusing on complex reasoning questions that require synthesizing information across visual chart elements. It evaluates multimodal large language models on their ability to understand and reason about scientific charts from arXiv papers through various reasoning tasks.

Tier B

B

Established: 15 or more models scored, or curated RL directories rate it.

How much stands behind a tier: usage, who backs it, a confirmed line from its own site or paper, and a clear read on X. High with three of the four, medium with two, low otherwise.

  • 45 models scored
  • in curated RL directories (2 pts)

On X · unclear, low buzz, from 1 post about CharXiv-R in the last month

CharXiv appears only as one line in an unverified leaked Gemini benchmark sheet, with no discussion of the benchmark itself.

@DevvratHans ↗

How we got to tier B
  1. Adoption: 45 models scored. Tier B.
  2. On X: unclear, low buzz. “CharXiv appears only as one line in an unverified leaked Gemini benchmark sheet, with no discussion of the benchmark itself.” No move.
  3. In curated RL directories: 2 points, a floor of C.
  4. Not yet confirmed by a line from its own site or paper.

A clear view on X moves a tier one step up or down; most entries don't move. How tiers work.

Not on the map yet: no line from its own site or paper places it in a domain.

Next: browse all benchmarks. Entry from the RL Research daily scrape of public sources, 2026-10-11 snapshot.