RL environment companies and startups
Every company building RL environments we track, and the environments listed under them. Each row opens a page with what it sells, its domains and companies like it.
74 confirmed · 5 not yet confirmed · from 115 directory listings · snapshot 2026-11-05 · type to filter, click a header to sort
Who sells RL environments, by domain
The companies that sell RL environments, evals and verifiers, each in the domain it leads with. Click one for the lines from its own site that put it there; the table below lists every company.
/
RL environments
The companies that sell RL environments, evals and verifiers, each placed in the domain it leads with. Crowded domains are competitive; some have companies covering them but none leading.
Glow · what it leads with selling
Hold ⌘ or Ctrl and scroll to zoom · drag to rotate · shift-drag or right-drag to move
The galaxy could not load. See every vendor on the board.
How to read it
A company, in the domain its own site leads with. The logo is its own; the glow is what it mainly sells.
Also covers: a ring at a domain's edge for a company that leads with another domain but also covers this one. A faint line runs to where it leads.
Dots around it: the other things it sells. Hollow while it is still expanding into them.
Click any star for the lines from its own website that put it there.
How to read it
A benchmark, in the domain most of its tasks are in. The logo is who built it.
Also covers: a benchmark mostly about another domain that also tests this one.
Lineage: a line from a benchmark to one built on it: its next version, a subset, an extension, or an index that combines it.
Click any star for the line from its own page or paper that put it there, and to light its lineage.
| Tier | Company | Funding | Domains |
|---|---|---|---|
| Confirmed 74Each placed by a line from its own site or paper. These are on the map. | |||
| S | Scale AI Sells expert-sourced training data and evaluations to frontier model builders, and builds and operates AI… | $15BY Combinator S16 | Coding Computer Use+3 |
| S | Snorkel AI Sells specialized expert training data, RL environments and benchmarks/evals to frontier AI labs and AI teams. | $570M | Coding Computer Use+3 |
| S | Prime Intellect Sells an open-source stack for agentic RL: an Environments Hub, hosted evaluations, hosted RL post-training,… | $150M | Coding Enterprise Workflows+2 |
| S | AfterQuery Sells expert-generated AI training data (SFT, RLHF, rubric-based RL), tool-calling and computer-use RL… | $30MY Combinator W25 | Multi-Domain Coding+2 |
| S | Mercor Runs a network of professional experts that supplies human data, evals, benchmarks and RL environments to… | $450M | Multi-Domain Coding+2 |
| S | Turing Supplies frontier AI labs with expert human data, RL environments, datasets and benchmarks, and provides… | $225M | Coding Enterprise Workflows+1 |
| S | micro1 Sells expert human data, RL environments (Realm), contextual agent evaluations (Cortex) and real-world… | $35M | Multi-Domain Enterprise Workflows |
| S | Vals AI Is an independent evaluator that benchmarks AI models and applications on professional tasks and frontier… | $40M | |
| S | Handshake Supplies human expert data and agentic training environments, graders and benchmarks to AI labs, drawing on… | Multi-Domain | |
| S | Surge AI Sells expert human data (RLHF, SFT, rubrics, human evaluation) plus custom and off-the-shelf RL environments… | Enterprise Workflows Multi-domain+12 | |
| S | Toloka Sells expert-sourced human data, custom datasets, RL-gym environments and evaluations for training and… | $72M | Multi-Domain |
| S | Uber AI Solutions sells human data services — data collection, annotation, testing and evaluation from a global… | Audio | |
| A | Gray Swan AI Sells AI security products: Shade automated red teaming of models and agents, Cygnal runtime guardrails that… | $50M | |
| A | Fleet AI Builds high-fidelity simulated training environments ('gyms') and evals that model real-world work for… | Computer Use Enterprise Workflows+1 | |
| A | Deeptune Acquired by MercorBuilds RL training gyms for frontier labs: simulated environments mimicking software like Slack and Salesforce… | $48.3M | Coding Computer Use+2 |
| A | Bespoke Labs Builds company-scale RL environments and infrastructure, plus agent evaluation and GEPA-based optimization,… | $40M | Coding Long-Horizon |
| A | Halluminate Builds RL environments and benchmarks for AI agents doing knowledge work, starting with financial services due… | $38.5MY Combinator S25 | Finance Enterprise Workflows+1 |
| A | Patronus AI Builds RL tasks with expert reference solutions and graders, plus ready-built and custom simulated… | $70M | Multi-Domain Coding |
| A | Revelo Sells expert-authored coding data, RL environments, evals and engineer staffing to AI labs, drawing on its… | $48M | Coding |
| A | Parsewave Sells custom, fully human-authored datasets, solution traces and expert evaluations, written mainly by senior… | Long-Horizon | |
| A | Latch Builds verifiable benchmarks for evaluating AI agents on biology and drug-discovery tasks, alongside a data… | $33M | Science |
| B | Proximal Is a research lab that builds complex post-training data and long-horizon coding environments for frontier… | $15M | Coding Long-Horizon+1 |
| B | Mechanize Builds high-fidelity, long-horizon RL environments and evals for frontier coding agents, including the open… | $9.1M | Coding Private Codebases |
| B | Andon Labs Builds long-horizon agent evals such as Vending-Bench and runs real AI-operated businesses as safety testbeds,… | Y Combinator W24 | Computer Use Long-Horizon |
| B | Veris AI Sells a simulation platform that builds stateful twins of an enterprise's systems, data, APIs and users so AI… | $8.5M | Enterprise Workflows |
| B | Collinear Sells Simulation Lab RL environments with simulated users, tools and verifiers, plus off-the-shelf tasks,… | Security Enterprise Workflows+3 | |
| B | Good Start Labs Sells game-based RL environments, human gameplay data, synthetic data and benchmarks to AI labs for training… | $3.6M | Games Long-Horizon |
| B | General Reasoning Is an AI research lab that runs OpenReward, a platform for serving and running RL environments, and also sells… | Finance Coding+1 | |
| B | Chakra Labs Sells deterministic clones of production software (Notion, Salesforce, Gmail, GitHub and more) as GUI and MCP… | $10.1M | Computer Use Tool Use |
| B | Huzzle Labs Builds long-horizon RL environments for coding, computer use and enterprise workflows for frontier AI labs,… | Long-Horizon Coding+3 | |
| B | Idler Builds reinforcement learning environments and evals from real production work for frontier AI labs, spanning… | Y Combinator S25 | Coding Enterprise Workflows+1 |
| B | Datacurve Sells expert-sourced training data for frontier AI labs, including RL environments, long-horizon tasks, agent… | $17.7MY Combinator W24 | Coding Private Codebases |
| B | Pareto Supplies expert human data for training frontier AI models through a global network of specialists, and… | $5.1M | Multi-Domain Tool Use |
| B | Emulated Builds post-training datasets and environments for software engineering and AI R&D, and publishes benchmarks… | ML Science | |
| B | HUD Sells an SDK and hosted platform for building, running, training and evaluating models on RL environments,… | $16MY Combinator W25 | Long-Horizon Coding+2 |
| B | Taste Labs Builds design-focused post-training data and evaluation infrastructure for frontier labs, and sells a Brand… | $18.5MLatitud Fellowship 2024 | Creative |
| B | Contra Labs Sells creative-AI evaluations, benchmarks, expert human preference data, datasets and computer-use… | Creative Coding | |
| B | Aptura Supplies expert human data, curated datasets and RL environments for training and evaluating AI in finance,… | Finance Enterprise Workflows | |
| B | Quesma Sells an analytics product that collects Claude Code, Codex and Cursor session logs to show what coding agents… | $2.5M | Security |
| B | ReasonCore AI sells expert-verified reasoning datasets, sandboxed RL environments and adaptive evals-as-a-service across… | Science Coding | |
| B | Verita AI Runs a community of PhD-level experts and consultants who provide personalized human preference data, tasks… | Creative | |
| B | ARIMLABS Builds RLVR training environments and benchmarks for long-horizon AI agents in cybersecurity, SRE, compilation… | Security Long-Horizon | |
| B | Incalmo Builds high-fidelity, verifiable RL environments for training AI models on realistic cybersecurity tasks,… | Security | |
| B | Preference Model Builds hardened RL environments with robust graders for frontier labs to train capable, better-aligned models,… | $16M | ML Coding |
| B | Symbal Sells evals, benchmarks and post-training datasets built with an expert labor pool to frontier labs, and… | Coding Enterprise Workflows | |
| B | dmodel D_model is an AI research lab that builds RL environments for open-ended interpretability and alignment… | $500KY Combinator S24 | ML Alignment |
| C | Refresh Builds RL environments and evals with verifiable rewards for coding, computer use (cloned software suites like… | Y Combinator X25 | Coding Computer Use+1 |
| C | Normal Is an applied research lab selling data and evals, such as CAD benchmarks and datasets, to advance AI… | Y Combinator S25 | Chip Design |
| C | Hillclimb Builds and sells RL environments and aggregated human research data to frontier labs to improve models' AI… | Y Combinator F25 | Math |
| C | BenchFlow Is an open-source frontier environment lab that builds RL environments and agent benchmarks (SkillsBench,… | Enterprise Workflows Browser+2 | |
| C | Vmax Is an RL research lab building Campaign, self-play task generation infrastructure that turns a customer's… | ML Coding+1 | |
| C | Cua Sells computer-use agent infrastructure — background desktop drivers, local and cloud sandboxes and elastic… | Y Combinator X25 | Coding Computer Use |
| C | Markov Sells computer-use datasets and CAD environments built from recorded human workflows (screen recordings,… | Y Combinator S26 | Computer Use Tool Use |
| C | Plato Builds simulated replicas of real software (CRMs, GitHub, Jira, Stripe, Linux desktops) as scored environments… | Browser Enterprise Workflows+1 | |
| C | Abundant Builds RL environments and datasets for AI labs and enterprises, with a focus on coding and physical sciences. | $500KY Combinator F24 | Coding |
| C | Aviro Builds reinforcement learning environments and post-training datasets for long-horizon coding, computer use,… | Y Combinator X25 | Coding ML |
| C | Ulam Sells research-grade mathematical reasoning datasets, private benchmarks and evaluations, and verifier-backed… | Math Science | |
| C | Ooak Data Turns real, anonymized company data into digital-twin RL environments and evaluation infrastructure for… | Y Combinator S26 | Enterprise Workflows |
| C | Theta Builds custom RL environments from client and expert data to train specialized agents for frontier labs and… | Y Combinator X25 | Enterprise Workflows |
| C | Third Moment Research sells fully managed, OpenAI API-compatible inference endpoints that it continually improves by… | Coding Finance | |
| C | Vetto AI Is a post-training data research partner for frontier labs, providing RL environments, rubrics and verifiers,… | Coding Computer Use | |
| C | Andromede Is an RL data lab that programmatically generates RL environments, tasks and verifiers from real-world data… | Long-Horizon | |
| C | EdotEnv Builds multi-step RL environments and benchmarks from financial market data for frontier labs to evaluate and… | Y Combinator S26 | Long-Horizon ML |
| C | Rise Data Labs Sells human data services, supplying US-based expert trainers and annotation tools for labeling, RLHF and… | Enterprise Workflows Finance+5 | |
| D | AIChamp Sells non-invasive factory loss checks and digital twins of manufacturing stations in which vendor-neutral… | Enterprise Workflows Long-Horizon | |
| D | Habitat Inc Builds verifiable coding RL tasks from real open-source commits using a paid network of engineers, and now… | Coding Computer Use+1 | |
| D | Metaphi AI builds training environments to make AI agents reliable for enterprise workloads, and offers a terminal… | Coding Enterprise Workflows | |
| D | pre.dev Sells a coding agent for building and shipping software, and also sells long-horizon, verified RL coding tasks… | Coding Long-Horizon | |
| D | Tacit Labs Builds data, long-horizon evaluations and RL research environments for training frontier models on biology,… | Science Long-Horizon | |
| D | Align AI Sells a runtime verification layer for AI agents, along with domain-specific RL environments, a ground-truth… | Enterprise Workflows Coding | |
| D | Anthromind Provides expert-curated, fully managed data for post-training, RLHF and custom evaluations of AI models. | Healthcare Long-Horizon | |
| D | Diffuse Labs Builds reinforcement learning environments, generated from merged PRs, agent traces and CI failures, that… | ML Long-Horizon | |
| D | Dissei Sells finance-focused AI training data, reference trajectories, sealed evaluations and graders, and packaged… | Finance | |
| D | Trajectory Labs Provides expert red teaming, safety evaluations and RL environments to frontier AI labs, connecting top red… | Alignment | |
| Not yet confirmed 5Listed in the catalog; no line from its own site or paper confirms it yet. | |||
| A | Originator | Computer Use Coding | |
| B | Phinity | $5.2MPearX S25 | Chip Design |
| B | Matrices | AI Grant Batch 3 | Computer Use |
| C | Sepal AI | Y Combinator S24 | Enterprise Workflows Long-Horizon Math |
| D | Ionic | Finance Law | |
No entries match. Clear the filter above to see all 79.