Local Model Bench

Mistral Small 4

2026-05-28T15-42-25Z_openrouter_mistralai_mistral-small-2603

api cheap run: not executed on the Mac mini local LM Studio setup, included as a comparison target rather than a local-model result.

review Visual sample result
2/3 Automated checks
1/1 SVG artifact

Verdict

visual sample
review

1 artifact · 2/3 checks · review

no failure labels
Prompt set v1_city_plan_svg.json
Run type api cheap
Temperature 0
Top P 1
Missed tasks 1/1

SVG Artifacts

1 artifact · 2/3 checks · review
city_plan_3d_buildings_svg 2/3 · v1_city_plan_svg.json open SVG
city_plan_3d_buildings_svg SVG output

Task Results

Compact view; open a row for prompt and raw answer
Task Category Score Failed Checks Failure Types Prompt / Answer
city_plan_3d_buildings_svg svg 2/3 no_markdown none
Inspect

Prompt

Generate a valid standalone SVG of a city plan with a 3D-style representation of buildings.

Rules:
- SVG only
- no Markdown
- no external images
- no JavaScript
- include roads or city blocks
- include multiple buildings
- make at least some buildings appear 3D or isometric
- use simple vector shapes

Model answer

<svg xmlns="http://www.w3.org/2000/svg" viewBox="0 0 800 600" width="800" height="600">
  <!-- Background -->
  <rect width="100%" height="100%" fill="#e0f7fa"/>

  <!-- Roads -->
  <path d="M0,300 L800,300" stroke="#263238" stroke-width="20" stroke-linecap="round"/>
  <path d="M400,0 L400,600" stroke="#263238" stroke-width="20" stroke-linecap="round"/>
  <path d="M200,0 L200,600" stroke="#263238" stroke-width="10" stroke-linecap="round"/>
  <path d="M600,0 L600,600" stroke="#263238" stroke-width="10" stroke-linecap="round"/>
  <path d="M0,150 L800,150" stroke="#263238" stroke-width="10" stroke-linecap="round"/>
  <path d="M0,450 L800,450" stroke="#263238" stroke-width="10" stroke-linecap="round"/>

  <!-- Buildings -->
  <!-- Building 1 (3D) -->
  <polygon points="50,50 150,50 170,100 70,100" fill="#4caf50" stroke="#2e7d32" stroke-width="2"/>
  <polygon points="70,100 170,100 170,200 70,200" fill="#66bb6a" stroke="#2e7d32" stroke-width="2"/>
  <polygon points="150,50 170,100 170,200 150,150" fill="#81c784" stroke="#2e7d32" stroke-width="2"/>
  <rect x="80" y="120" width="40" height="60" fill="#2e7d32" stroke="#1b5e20" stroke-width="1"/>

  <!-- Building 2 (3D) -->
  <polygon points="250,100 350,100 370,150 270,150" fill="#ff9800" stroke="#e65100" stroke-width="2"/>
  <polygon points="270,150 370,150 370,250 270,250" fill="#ffb74d" stroke="#e65100" stroke-width="2"/>
  <polygon points="350,100 370,150 370,250 350,200" fill="#ffcc80" stroke="#e65100" stroke-width="2"/>
  <rect x="280" y="170" width="40" height="60" fill="#e65100" stroke="#b71c1c" stroke-width="1"/>

  <!-- Building 3 (3D) -->
  <polygon points="550,200 650,200 670,250 570,250" fill="#9c27b0" stroke="#7b1fa2" stroke-width="2"/>
  <polygon points="570,250 670,250 670,350 570,350" fill="#ba68c8" stroke="#7b1fa2" stroke-width="2"/>
  <polygon points="650,200 670,250 670,350 650,300" fill="#ce93d8" stroke="#7b1fa2" stroke-width="2"/>
  <rect x="580" y="270" width="40" height="60" fill="#7b1fa2" stroke="#4a148c" stroke-width="1"/>

  <!-- Building 4 (3D) -->
  <polygon points="300,350 400,350 420,400 320,400" fill="#f44336" stroke="#c62828" stroke-width="2"/>
  <polygon points="320,400 420,400 420,500 320,500" fill="#e57373" stroke="#c62828" stroke-width="2"/>
  <polygon points="400,350 420,400 420,500 400,450" fill="#ef9a9a" stroke="#c62828" stroke-width="2"/>
  <rect x="330" y="420" width="40" height="60" fill="#c62828" stroke="#8e2424" stroke-width="1"/>

  <!-- Building 5 (3D) -->
  <polygon points="600,450 700,450 720,500 620,500" fill="#2196f3" stroke="#0d47a1" stroke-width="2"/>
  <polygon points="620,500 720,500 720,600 620,600" fill="#64b5f6" stroke="#0d47a1" stroke-width="2"/>
  <polygon points="700,450 720,500 720,600 700,550" fill="#90caf9" stroke="#0d47a1" stroke-width="2"/>
  <rect x="630" y="520" width="40" height="60" fill="#0d47a1" stroke="#01579b" stroke-width="1"/>

  <!-- Building 6 (Simple) -->
  <rect x="100" y="350" width="60" height="100" fill="#795548" stroke="#5d4037" stroke-width="2"/>
  <rect x="110" y="360" width="40" height="20" fill="#a1887f" stroke="#5d4037" stroke-width="1"/>

  <!-- Building 7 (Simple) -->
  <rect x="450" y="200" width="80" height="120" fill="#ffeb3b" stroke="#f57f17" stroke-width="2"/>
  <rect x="470" y="220" width="40" height="20" fill="#fff176" stroke="#f57f17" stroke-width="1"/>

  <!-- Building 8 (Simple) -->
  <rect x="200" y="500" width="50" height="80" fill="#9e9d24" stroke="#827717" stroke-width="2"/>
  <rect x="210" y="510" width="30" height="20" fill="#d4e157" stroke="#827717" stroke-width="1"/>
</svg>