Bespoke Curator C
AI benchmark · Long-Horizon
- Publisher
- Bespoke Labs
- Domains
- Long-Horizon
- On X
- @bespokelabsai ↗
- Tier
- C why
- Snapshot
Latest from Bespoke Labs on X
@bespokelabsai ↗Tier C
Niche: a handful of models scored, or built by an RL vendor.
How much stands behind a tier: usage, who backs it, a confirmed line from its own site or paper, and a clear read on X. High with three of the four, medium with two, low otherwise.
- built by Bespoke Labs
- in curated RL directories (2 pts)
How we got to tier C
- Adoption: built by Bespoke Labs. Tier C.
- Not yet read on X.
- In curated RL directories: 2 points, a floor of C.
- Not yet confirmed by a line from its own site or paper.
A clear view on X moves a tier one step up or down; most entries don't move. How tiers work.
Training methods
Methods Bespoke Curator uses, offers or builds for, with public evidence: its own website says so, or two independent sites do.
- GRPO Group Relative Policy Optimization On its own website
“We are excited to share some recent findings which show that RL can improve multi-step tool use capabilities, a first milestone. Using GRPO, the core algorithm behind DeepSeek-R1, we improved Qwen2.5-7B-Instruct’s tool use performance by 23% on a subset of the BFCL benchmark using only 100 training samples. The tasks in this benchmark require an agent to or…”
bespokelabs.ai“We use supervised fine-tuning (SFT) with trajectories coming from a strong teacher model, and reinforcement learning (GRPO) on the fontTools specialized environments that we curate. SFT gives a 52pp improvement in performance on the held-out fontTools evaluation set. Further RL training lifts the total improvement to 57pp compared to the ba…”
bespokelabs.ai - SFT Supervised Fine-Tuning On its own website
“Can an open coding model be post-trained to work better on a specific repository? How do we use SFT and RL to improve performance? To answer these questions, we curate coding tasks specialized for a repository and post-train Inkling using SFT and RL. Here, we focus on the fontTools open-source repository, but our meth…”
bespokelabs.ai“The pipeline combines synthetic data with engineered distributions, supervised fine-tuning of Llama 3.1 8B with LoRA, and GEPA prompt optimization. Teacher-generated explanations undergo rejection sampling before training. Evaluations then check product accuracy, legal and partner compliance, and product requ…”
bespokelabs.ai
Not on the map yet: no line from its own site or paper places it in a domain.
Next: browse all benchmarks. Entry from the RL Research daily scrape of public sources, 2026-10-11 snapshot.