Galactica, Llama 2, Llama 3 C

Name: Galactica, Llama 2, Llama 3
Creator: General Reasoning
Keywords: Coding,Long-Horizon

AI benchmark · Coding

Publisher: General Reasoning
Domains: Coding Long-Horizon
On X: @GenReasoning ↗
Tier: C why
Snapshot: October 11, 2026

Open benchmark ↗arxiv.org/abs/2604.27865

Full listing name: Galactica, Llama 2, Llama 3 (founders' prior work at Meta)

Latest from General Reasoning on X

@GenReasoning ↗

🔍 Introducing BackSearch. LLMs are increasingly asked to predict the future, but a good backtest requires a snapshot of the internet at a point in time. BackSearch allows LLMs to search the web as it was on a particular date. It’s great for: 🔮 Forecasting and prediction markets. 📈 Quantitative finance. 🌍 RL environments that simulate the world. 🥶 Freezing websearch for benchmark reproducibility We’re releasing a narrow slice of our index to begin with, focused on the news domain for 2026. Based on feedback we’ll open up more of our index in subsequent releases. 👇 Try BackSearch out with the link below.
— GenReasoning (@GenReasoning) Jul 24, 2026
OpenReward integration for FutureSim by @ShashwatGoel7 and team! 👇 Try it it out
— GenReasoning (@GenReasoning) Jun 26, 2026
We evaluated recent open models on KellyBench. Here is what we found: 🏆 GLM 5.2 is new open source SoTA, but still loses -30% on average over 5 runs. 📈 We estimate GLM 5.2 is 6+ months behind the frontier based on KellyBench and internal quant evaluations. (Note: we have not evaluated Fable) 🌗 Kimi K2.6 slightly improves on Kimi K2.5 but still struggles at -60% average RoI. 🐈 Recent Mistral models struggle, obtaining mean RoIs of -78% and -99% respectively. Leaderboard link and more graphs below.
— GenReasoning (@GenReasoning) Jun 18, 2026

Tier C

Niche: a handful of models scored, or built by an RL vendor.

How much stands behind a tier: usage, who backs it, a confirmed line from its own site or paper, and a clear read on X. High with three of the four, medium with two, low otherwise.

built by General Reasoning
in curated RL directories (2 pts)

How we got to tier C

Adoption: built by General Reasoning. Tier C.
Not yet read on X.
In curated RL directories: 2 points, a floor of C.
Not yet confirmed by a line from its own site or paper.

A clear view on X moves a tier one step up or down; most entries don't move. How tiers work.

Not on the map yet: no line from its own site or paper places it in a domain.

More Coding AI benchmarks

Coding RL environments

Next: browse all benchmarks. Entry from the RL Research daily scrape of public sources, 2026-10-11 snapshot.