Local Model Bench

gemini-2.5-flash

2026-05-17T18-34-20Z_openrouter_google_gemini-2.5-flash

api cheap run: not executed on the Mac mini local LM Studio setup, included as a comparison target rather than a local-model result.

pass Visual sample result
3/3 Automated checks
1/1 SVG artifact

Verdict

visual sample
pass

1 artifact · 3/3 checks · pass

no failure labels
Prompt set v1_city_plan_svg.json
Run type api cheap
Temperature 0
Top P 1
Missed tasks 0/1

SVG Artifacts

1 artifact · 3/3 checks · pass
city_plan_3d_buildings_svg 3/3 · v1_city_plan_svg.json open SVG
city_plan_3d_buildings_svg SVG output

Task Results

Compact view; open a row for prompt and raw answer
Task Category Score Failed Checks Failure Types Prompt / Answer
city_plan_3d_buildings_svg svg 3/3 none none
Open

Prompt

Generate a valid standalone SVG of a city plan with a 3D-style representation of buildings.

Rules:
- SVG only
- no Markdown
- no external images
- no JavaScript
- include roads or city blocks
- include multiple buildings
- make at least some buildings appear 3D or isometric
- use simple vector shapes

Model answer

<svg width="800" height="600" viewBox="0 0 800 600" xmlns="http://www.w3.org/2000/svg">
  <defs>
    <linearGradient id="buildingGradient1" x1="0%" y1="0%" x2="100%" y2="100%">
      <stop offset="0%" style="stop-color:#a0a0a0;stop-opacity:1" />
      <stop offset="100%" style="stop-color:#606060;stop-opacity:1" />
    </linearGradient>
    <linearGradient id="buildingGradient2" x1="0%" y1="0%" x2="100%" y2="100%">
      <stop offset="0%" style="stop-color:#b0b0b0;stop-opacity:1" />
      <stop offset="100%" style="stop-color:#707070;stop-opacity:1" />
    </linearGradient>
    <linearGradient id="buildingGradient3" x1="0%" y1="0%" x2="100%" y2="100%">
      <stop offset="0%" style="stop-color:#c0c0c0;stop-opacity:1" />
      <stop offset="100%" style="stop-color:#808080;stop-opacity:1" />
    </linearGradient>
  </defs>

  <!-- Background -->
  <rect x="0" y="0" width="800" height="600" fill="#e0e0e0"/>

  <!-- Roads -->
  <rect x="0" y="100" width="800" height="40" fill="#404040"/>
  <rect x="0" y="250" width="800" height="40" fill="#404040"/>
  <rect x="0" y="400" width="800" height="40" fill="#404040"/>
  <rect x="100" y="0" width="40" height="600" fill="#404040"/>
  <rect x="300" y="0" width="40" height="600" fill="#404040"/>
  <rect x="500" y="0" width="40" height="600" fill="#404040"/>
  <rect x="700" y="0" width="40" height="600" fill="#404040"/>

  <!-- Road markings -->
  <line x1="0" y1="120" x2="800" y2="120" stroke="#f0f0f0" stroke-width="2" stroke-dasharray="10 10"/>
  <line x1="0" y1="270" x2="800" y2="270" stroke="#f0f0f0" stroke-width="2" stroke-dasharray="10 10"/>
  <line x1="0" y1="420" x2="800" y2="420" stroke="#f0f0f0" stroke-width="2" stroke-dasharray="10 10"/>
  <line x1="120" y1="0" x2="120" y2="600" stroke="#f0f0f0" stroke-width="2" stroke-dasharray="10 10"/>
  <line x1="320" y1="0" x2="320" y2="600" stroke="#f0f0f0" stroke-width="2" stroke-dasharray="10 10"/>
  <line x1="520" y1="0" x2="520" y2="600" stroke="#f0f0f0" stroke-width="2" stroke-dasharray="10 10"/>
  <line x1="720" y1="0" x2="720" y2="600" stroke="#f0f0f0" stroke-width="2" stroke-dasharray="10 10"/>

  <!-- Buildings (3D style) -->
  <!-- Building 1 -->
  <polygon points="150,80 200,50 250,80 250,180 200,210 150,180" fill="url(#buildingGradient1)"/>
  <polygon points="200,50 250,80 250,180 200,210" fill="url(#buildingGradient2)"/>
  <polygon points="150,80 200,50 200,210 150,180" fill="url(#buildingGradient3)"/>

  <!-- Building 2 -->
  <polygon points="350,200 400,170 450,200 450,300 400,330 350,300" fill="url(#buildingGradient1)"/>
  <polygon points="400,170 450,200 450,300 400,330" fill="url(#buildingGradient2)"/>
  <polygon points="350,200 400,170 400,330 350,300" fill="url(#buildingGradient3)"/>

  <!-- Building 3 -->
  <polygon points="550,50 600,20 650,50 650,150 600,180 550,150" fill="url(#buildingGradient1)"/>
  <polygon points="600,20 650,50 650,150 600,180" fill="url(#buildingGradient2)"/>
  <polygon points="550,50 600,20 600,180 550,150" fill="url(#buildingGradient3)"/>

  <!-- Building 4 -->
  <polygon points="150,450 200,420 250,450 250,550 200,580 150,550" fill="url(#buildingGradient1)"/>
  <polygon points="200,420 250,450 250,550 200,580" fill="url(#buildingGradient2)"/>
  <polygon points="150,450 200,420 200,580 150,550" fill="url(#buildingGradient3)"/>

  <!-- Building 5 -->
  <polygon points="350,450 400,420 450,450 450,550 400,580 350,550" fill="url(#buildingGradient1)"/>
  <polygon points="400,420 450,450 450,550 400,580" fill="url(#buildingGradient2)"/>
  <polygon points="350,450 400,420 400,580 350,550" fill="url(#buildingGradient3)"/>

  <!-- Building 6 -->
  <polygon points="550,450 600,420 650,450 650,550 600,580 550,550" fill="url(#buildingGradient1)"/>
  <polygon points="600,420 650,450 650,550 600,580" fill="url(#buildingGradient2)"/>
  <polygon points="550,450 600,420 600,580 550,550" fill="url(#buildingGradient3)"/>

  <!-- Simple buildings -->
  <rect x="20" y="20" width="60" height="60" fill="#909090"/>
  <rect x="20" y="160" width="60" height="60" fill="#909090"/>
  <rect x="20" y="300" width="60" height="60" fill="#909090"/>
  <rect x="20" y="450" width="60" height="60" fill="#909090"/>

  <rect x="200" y="20" width="60" height="60" fill="#909090"/>
  <rect x="200" y="160" width="60" height="60" fill="#909090"/>
  <rect x="200" y="300" width="60" height="60" fill="#909090"/>
  <rect x="200" y="450" width="60" height="60" fill="#909090"/>

  <rect x="400" y="20" width="60" height="60" fill="#909090"/>
  <rect x="400" y="160" width="60" height="60" fill="#909090"/>
  <rect x="400" y="300" width="60" height="60" fill="#909090"/>
  <rect x="400" y="450" width="60" height="60" fill="#909090"/>

  <rect x="600" y="20" width="60" height="60" fill="#909090"/>
  <rect x="600" y="160" width="60" height="60" fill="#909090"/>
  <rect x="600" y="300" width="60" height="60" fill="#909090"/>
  <rect x="600" y="450" width="60" height="60" fill="#909090"/>

  <rect x="750" y="20" width="30" height="80" fill="#909090"/>
  <rect x="750" y="150" width="30" height="80" fill="#909090"/>
  <rect x="750" y="290" width="30" height="80" fill="#909090"/>
  <rect x="750" y="430" width="30" height="80" fill="#909090"/>
</svg>