Local Model Bench

Seed 2.0 Mini

2026-05-28T17-56-32Z_openrouter_bytedance-seed_seed-2.0-mini

api cheap run: not executed on the Mac mini local LM Studio setup, included as a comparison target rather than a local-model result.

fail Visual sample result
2/3 Automated checks
0/1 SVG artifact

Verdict

visual sample
fail

0 artifact · 2/3 checks · fail

no failure labels
Prompt set v1_city_plan_svg.json
Run type api cheap
Temperature 0
Top P 1
Missed tasks 1/1

SVG Artifacts

0 artifact · 2/3 checks · fail

No parseable SVG files are available for this model. The visual run may exist, but the model did not return valid standalone SVG output.

Task Results

Compact view; open a row for prompt and raw answer
Task Category Score Failed Checks Failure Types Prompt / Answer
city_plan_3d_buildings_svg svg 2/3 valid_svg_basic none
Inspect

Prompt

Generate a valid standalone SVG of a city plan with a 3D-style representation of buildings.

Rules:
- SVG only
- no Markdown
- no external images
- no JavaScript
- include roads or city blocks
- include multiple buildings
- make at least some buildings appear 3D or isometric
- use simple vector shapes

Model answer

<svg width="800" height="600" viewBox="0 0 800 600" xmlns="http://www.w3.org/2000/svg">
  <!-- Background city grid/roads -->
  <rect width="800" height="600" fill="#a1c688"/>
  <g stroke="#777777" stroke-width="2" fill="none">
    <!-- Main horizontal roads -->
    <line x1="50" y1="200" x2="750" y2="200"/>
    <line x1="50" y1="400" x2="750" y2="400"/>
    <!-- Main vertical roads -->
    <line x1="200" y1="50" x2="200" y2="550"/>
    <line x1="400" y1="50" x2="400" y2="550"/>
    <line x1="600" y1="50" x2="600" y2="550"/>
    <!-- Side road segments -->
    <line x1="50" y1="300" x2="200" y2="300"/>
    <line x1="400" y1="300" x2="600" y2="300"/>
    <line x1="600" y1="300" x2="750" y2="300"/>
    <line x1="200" y1="100" x2="400" y2="100"/>
    <line x1="200" y1="500" x2="400" y2="500"/>
  </g>

  <!-- Road markings -->
  <g stroke="#ffffff" stroke-width="1" stroke-dasharray="5,3">
    <line x1="100" y1="200" x2="180" y2="200"/>
    <line x1="220" y1="200" x2="380" y2="200"/>
    <line x1="420" y1="200" x2="580" y2="200"/>
    <line x1="620" y1="200" x2="700" y2="200"/>
    <line x1="100" y1="400" x2="180" y2="400"/>
    <line x1="220" y1="400" x2="380" y2="400"/>
    <line x1="420" y1="400" x2="580" y2="400"/>
    <line x1="620" y1="400" x2="700" y2="400"/>
    <line x1="200" y1="100" x2="200" y2="180"/>
    <line x1="200" y1="220" x2="200" y2="380"/>
    <line x1="200" y1="420" x2="200" y2="500"/>
    <line x1="400" y1="100" x2="400" y2="180"/>
    <line x1="400" y1="220" x2="400" y2="380"/>
    <line x1="400" y1="420" x2="400" y2="500"/>
    <line x1="600" y1="100" x2="600" y2="180"/>
    <line x1="600" y1="220" x2="600" y2="380"/>
    <line x1="600" y1="420" x2="600" y2="500"/>
  </g>

  <!-- 3D Isometric Buildings -->
  <!-- Small residential block 1 -->
  <g transform="translate(70, 70)">
    <path d="M0,0 L80,0 L80,60 L0,60 Z" fill="#8ba2b9" stroke="#555555" stroke-width="1"/>
    <path d="M80,0 L120,40 L120,100 L80,60 Z" fill="#6b8299" stroke="#555555" stroke-width="1"/>
    <path d="M0,60 L80,60 L120,100 L0,100 Z" fill="#a1b7d0" stroke="#555555" stroke-width="1"/>
    <rect x="20" y="10" width="40" height="30" fill="#ffffff" stroke="#555555" stroke-width="0.5"/>
    <rect x="20" y="50" width="15" height="15" fill="#ffffff" stroke="#555555" stroke-width="0.5"/>
    <rect x="45" y="50" width="15" height="15" fill="#ffffff" stroke="#555555" stroke-width="0.5"/>
  </g>

  <!-- Medium office building 1 -->
  <g transform="translate(270, 120)">
    <rect x="0" y="0" width="100" height="120" fill="#9a7b6b" stroke="#444444" stroke-width="1"/>
    <polygon points="100,0 130,40 130,160 100,120" fill="#7a5b4b" stroke="#444444" stroke-width="1"/>
    <polygon points="0,120 100,120 130,160 0,160" fill="#ba9b8b" stroke="#444444" stroke-width="1"/>
    <rect x="15" y="15" width="20" height="20" fill="#ffffff" stroke="#444444" stroke-width="0.5"/>
    <rect x="45" y="15" width="20" height="20" fill="#ffffff" stroke="#444444" stroke-width="0.5"/>
    <rect x="75" y="15" width="20" height="20" fill="#ffffff" stroke="#444444" stroke-width="0.5"/>
    <rect x="15" y="45" width="20" height="20" fill="#ffffff" stroke="#444444" stroke-width="0.5"/>
    <rect x="45" y="45" width="20" height="20" fill="#ffffff" stroke="#444444" stroke-width="0.5"/>
    <rect x="75" y="45" width="20" height="20" fill="#ffffff" stroke="#444444" stroke-width="0.5"/>
    <rect x="15" y="75" width="20" height="20" fill="#ffffff" stroke="#444444" stroke-width="0.5"/>
    <rect x="45" y="75" width="20" height="20" fill="#ffffff" stroke="#444444" stroke-width="0.5"/>
    <rect x="75" y="75" width="20" height="20" fill="#ffffff" stroke="#444444" stroke-width="0.5"/>
  </g>

  <!-- Large commercial building -->
  <g transform="translate(470, 80)">
    <rect x="0" y="0" width="140" height="160" fill="#556677" stroke="#333333" stroke-width="1"/>
    <polygon points="140,0 180,40 180,200 140,160" fill="#334455" stroke="#333333" stroke-width="1"/>
    <polygon points="0,160 140,160 180,200 0,200" fill="#778899" stroke="#333333" stroke-width="1"/>
    <!-- Window rows -->
    <g fill="#ffffff" stroke="#333333" stroke-width="0.5">
      <rect x="15" y="15" width="25" height="20"/>
      <rect x="50" y="15" width="25"