LLMForge evaluation benchmark C

AI benchmark

Built by
J. de Curtò I. de Zarzà Victoria Guillén BSC-CNS / ICAI Comillas / Chung-Ang University / LIST Luxembourg
Tier
C why
Snapshot

Open benchmark ↗github.com/drdecurto/LLMforge

What is LLMForge evaluation benchmark?

LLMForge evaluates foundation models on generating parametric CAD designs of mechanical parts from natural-language specifications across a benchmark of 97 engineering design problems.

  • Robotics mostly

    “an empirical study of foundation models for automatic Computer-Aided Design (CAD) generation of mechanical parts, using a unified evaluation pipeline and a curated benchmark of 97 engineering design problems”
    arxiv.org/abs/2607.05573v1 ↗

Who built LLMForge evaluation benchmark

Led by J. de Curtò, Victoria Guillén, I. de Zarzà (BSC-CNS / ICAI Comillas / Chung-Ang University / LIST Luxembourg).

    Paper: arxiv.org/abs/2607.05573v1 ↗

    Tier C

    C

    Niche: a handful of models scored, or built by an RL vendor.

    How much stands behind a tier: usage, who backs it, a confirmed line from its own site or paper, and a clear read on X. High with three of the four, medium with two, low otherwise.

    • 6 models scored
    • in curated RL directories (1 pt)
    How we got to tier C
    1. Adoption: 6 models scored. Tier C.
    2. Not yet read on X.
    3. In curated RL directories: 1 point, a floor of none.
    4. Confirmed: a line from its own site or paper places it.

    A clear view on X moves a tier one step up or down; most entries don't move. How tiers work.

    Where LLMForge evaluation benchmark sits

    Its domain on the map, live. Hover a logo for its name; click to open it. Open it on the full map

    The galaxy could not load. See every vendor on the board.

    Next: browse all benchmarks. Entry from the RL Research daily scrape of public sources, 2026-10-19 snapshot.