BinaryAudit B
AI benchmark · Security
- Publisher
- Quesma
- Domains
- Security
- On X
- @QuesmaOrg ↗
- Tier
- B why
- Snapshot
Latest from Quesma on X
@QuesmaOrg ↗What is BinaryAudit?
BinaryAudit measures AI agents' ability to find backdoors and timebombs hidden in stripped compiled binaries of real open-source software using reverse engineering tools.
Security mostly
“An open-source benchmark for evaluating AI agents' ability to find backdoors hidden in compiled binaries of real open-source software.”
github.com/QuesmaOrg/binaryaudit ↗
Tier B
Established: 15 or more models scored, or curated RL directories rate it.
How much stands behind a tier: usage, who backs it, a confirmed line from its own site or paper, and a clear read on X. High with three of the four, medium with two, low otherwise.
- built by Quesma
- in curated RL directories (3 pts)
How we got to tier B
- Adoption: built by Quesma. Tier C.
- Not yet read on X.
- In curated RL directories: 3 points, a floor of B. Raised to B.
- Confirmed: a line from its own site or paper places it.
A clear view on X moves a tier one step up or down; most entries don't move. How tiers work.
Where BinaryAudit sits
Its realm in the universe, live. Hover a star for its name; click to open it. Open it in the universe
Next: browse all benchmarks. Entry from the RL Research daily scrape of public sources, 2026-10-11 snapshot.