Benchmark Results

5 models × 20 prompts across 4 difficulty tiers. Click any cell to see the generated code and 3D rendering.

LLM Baseline
Claude Opus 4.6
95%
19/20 · 6.9s avg
Commercial
Zoo ML-ephant
95%
19/20 · 11.1s avg
LLM Baseline
Gemini 2.5 Flash
70%
14/20 · 3.1s avg
LLM Baseline
GPT-5
60%
12/20 · 16.1s avg
Academic
Text2CadQuery (Qwen 3B)
70%
14/20 · 11.5s avg
TIER 1Basic primitives
PROMPT
Claude
Zoo
Gemini
GPT-5
Text2CadQuery
t1_01A cube 20mm × 20mm × 20mm.
✓
3DPY
✓
3DKCL
✓
3DPY
✓
3DPY
✓
3DPY
t1_02A solid cylinder 10mm in diameter and 30mm tall.
✓
3DPY
✓
3DKCL
✓
3DPY
✓
3DPY
✓
3DPY
t1_03A solid sphere with a radius of 15mm.
✓
3DPY
✓
3DKCL
✓
3DPY
✓
3DPY
✓
3DPY
t1_04A rectangular box 60mm long, 40mm wide, and 15mm tall.
✓
3DPY
✓
3DKCL
✓
3DPY
✓
3DPY
✓
3DPY
t1_05A flat disk 50mm in diameter and 5mm thick.
✓
3DPY
✓
3DKCL
✓
3DPY
✓
3DPY
✓
3DPY
TIER 2Multi-feature parts
PROMPT
Claude
Zoo
Gemini
GPT-5
Text2CadQuery
t2_01A rectangular plate 50mm × 30mm × 5mm with a single circular hole 8mm in diamete…
✓
3DPY
✓
3DKCL
✓
3DPY
✓
3DPY
✓
3DPY
t2_02A solid cylinder 30mm in diameter and 20mm tall with a coaxial through-hole 10mm…
✓
3DPY
✓
3DKCL
✓
3DPY
✓
3DPY
✓
3DPY
t2_03An L-shaped bracket: one arm 60mm long, the other arm 40mm long, both arms 20mm …
✓
3DPY
✓
3DKCL
✗
PY
✗
✗
PY
t2_04A square plate 60mm × 60mm × 4mm with four circular holes 5mm in diameter, one n…
✓
3DPY
✓
3DKCL
✓
3DPY
✓
3DPY
✗
PY
t2_05A disk 50mm in diameter and 8mm thick with six 4mm-diameter holes equally spaced…
✓
3DPY
✓
3DKCL
✓
3DPY
✓
3DPY
✓
3DPY
TIER 3Assemblies
PROMPT
Claude
Zoo
Gemini
GPT-5
Text2CadQuery
t3_01A flanged cylinder: a 20mm-diameter shaft 30mm tall sitting on a 40mm-diameter f…
✓
3DPY
✓
3DKCL
✓
3DPY
✗
✓
3DPY
t3_02A hollow rectangular box with outer dimensions 60mm × 50mm × 40mm, wall thicknes…
✓
3DPY
✓
3DKCL
✓
3DPY
✓
3DPY
✓
3DPY
t3_03A T-shaped cross-section bracket: a 80mm-wide horizontal top bar and a 40mm-tall…
✓
3DPY
✓
3DKCL
✓
3DPY
✗
✓
3DPY
t3_04A stepped shaft with three coaxial cylinders stacked: bottom section 20mm diamet…
✓
3DPY
✓
3DKCL
✓
3DPY
✓
3DPY
✓
3DPY
t3_05A rectangular plate 80mm × 60mm × 8mm with a rectangular pocket milled into the …
✓
3DPY
✓
3DKCL
✗
PY
✓
3DPY
✓
3DPY
TIER 4Complex geometry
PROMPT
Claude
Zoo
Gemini
GPT-5
Text2CadQuery
t4_01A spur gear with 20 teeth, module 2mm (so pitch diameter 40mm), face width 10mm,…
✓
3DPY
✓
3DKCL
✗
PY
✗
✓
3DPY
t4_02A hex bolt: a regular hexagonal head 13mm across flats and 8mm tall, with a cyli…
✓
3DPY
✓
3DKCL
✓
3DPY
✗
✗
PY
t4_03A 90-degree pipe elbow: 15mm inner diameter, 2mm wall thickness, with 25mm-long …
✓
PY
✓
3DKCL
✗
PY
✗
✗
PY
t4_04A helical compression spring: 20mm outer diameter, 1.5mm wire diameter, 10 activ…
✓
3DPY
✗
✗
PY
✗
✗
PY
t4_05A countersunk screw hole pattern: a flat plate 80mm × 60mm × 6mm with four count…
✗
PY
✓
3DKCL
✗
PY
✗
✗
PY
✓ = executed successfully✗ = failed3D= 3D render availablePY= source code available