Remote Labor Index B
AI benchmark · Coding
- Publisher
- Scale AI
- On X
- @scale_ai ↗
- Tier
- B why
- Snapshot
Full listing name: Remote Labor Index (2025-10-28)
Latest from Scale AI on X
@scale_ai ↗What is Remote Labor Index?
Remote Labor Index measures how well AI agents complete real-world, economically valuable freelance remote work projects compared to professional human deliverables.
“Successful automations were concentrated in specific creative domains, particularly audio tasks (sound effects, vocal separation), image generation (logos, ads), report writing, and data retrieval.”
labs.scale.com/leaderboard/rli ↗“Computer-Use: A GUI-based environment simulating human-computer interaction (mouse, keyboard).”
labs.scale.com/leaderboard/rli ↗“A command-line interface (OpenHands) for tasks in code, data, and file manipulation.”
labs.scale.com/leaderboard/rli ↗
Tier B
Established: 15 or more models scored, or curated RL directories rate it.
How much stands behind a tier: usage, who backs it, a confirmed line from its own site or paper, and a clear read on X. High with three of the four, medium with two, low otherwise.
- built by Scale AI
- in curated RL directories (3 pts)
How we got to tier B
- Adoption: built by Scale AI. Tier C.
- Not yet read on X.
- In curated RL directories: 3 points, a floor of B. Raised to B.
- Confirmed: a line from its own site or paper places it.
A clear view on X moves a tier one step up or down; most entries don't move. How tiers work.
Where Remote Labor Index sits
Its realm in the universe, live. Hover a star for its name; click to open it. Open it in the universe
Next: browse all benchmarks. Entry from the RL Research daily scrape of public sources, 2026-10-11 snapshot.