VLMBench B

Name: VLMBench
Creator: Turing
Keywords: Coding

AI benchmark · Coding

Publisher: Turing
Domains: Coding
On X: @turingcom ↗
Tier: B why
Snapshot: October 11, 2026

Open benchmark ↗vlm-bench.turing.com/

Latest from Turing on X

@turingcom ↗

Introducing Behavior2Code from Turing Frontier Research Lab: a more reliable benchmark than ProgramBench for evaluating AI agents on black-box program reconstruction and software reverse engineering tasks. Best model: 19/60 solved after three attempts. 35 remain unsolved across six models.
— turingcom (@turingcom) Oct 7, 2026
“With bio, the risk is a little bit asymmetric.” “If somebody comes up with a crazy virus, imagine something like Covid with a high viral coefficient in terms of how quickly it spreads with a high K factor, & maybe it is much more fatal than Covid was.” “You saw how hard it was to come up with vaccine production quickly. Deployment happens in the real world. We are limited by a lot of real world factors.” “There is more risk in terms of how quickly we will be able to combat these.” Our CEO @Jonsid shares his thoughts with @MollySOShea on AI’s bio risk and says it's scarier than cybersecurity risks because the downside could be catastrophic & we’d have no defense against it:
— turingcom (@turingcom) Oct 6, 2026
October is Cybersecurity Awareness Month. We want to remind staffing agencies and sourcing platforms to stay vigilant against individuals falsely claiming to represent Turing. If you are contacted by an individual or company claiming to represent Turing and asked to make a payment to onboard your company as a Turing partner, stay alert. Turing never asks companies to pay a fee to become authorized partners. We select partners based on their capabilities and performance, and @Turingcom pays authorized partners for their sourcing and recruiting services, not the other way around. If someone claiming to represent Turing asks your company for payment to be onboarded into our partner program, do not make a payment. Stay vigilant.
— turingcom (@turingcom) Oct 6, 2026

What is VLMBench?

VLMBench measures vision-language models on open-ended, image-based real-world business and STEM questions, such as finance, engineering, physics and math, scored by an LLM judge.

Finance
“Subject: Finance (Business)Persona: Financial AdvisorCapability: Numerical Reasoning”
vlm-bench.turing.com/ ↗
Enterprise work
“Tasks that are relevant to real-world applications in the workflow of business professionals, and help them make better decisions.”
vlm-bench.turing.com/ ↗
Science
“Subject: Physics (STEM)Persona: Science CuratorCapability: Numerical Reasoning”
vlm-bench.turing.com/ ↗
Media
“Introducing a challenging benchmark for vision-language models, focused on real-world tasks with practical applications.”
vlm-bench.turing.com/ ↗

Tier B

Established: 15 or more models scored, or curated RL directories rate it.

How much stands behind a tier: usage, who backs it, a confirmed line from its own site or paper, and a clear read on X. High with three of the four, medium with two, low otherwise.

5 models scored
built by Turing
in curated RL directories (4 pts)

How we got to tier B

Adoption: 5 models scored; built by Turing. Tier C.
Not yet read on X.
In curated RL directories: 4 points, a floor of B. Raised to B.
Not yet confirmed by a line from its own site or paper.

A clear view on X moves a tier one step up or down; most entries don't move. How tiers work.

Where VLMBench sits

Its realm in the universe, live. Hover a star for its name; click to open it. Open it in the universe

The galaxy could not load. See every vendor on the board.

More Coding AI benchmarks

Coding RL environments

Next: browse all benchmarks. Entry from the RL Research daily scrape of public sources, 2026-10-11 snapshot.