Granite 4.1 8B

2026-05-28T15-38-35Z_openrouter_ibm-granite_granite-4.1-8b

api cheap run: not executed on the Mac mini local LM Studio setup, included as a comparison target rather than a local-model result.

fail Visual sample result

2/3 Automated checks

0/1 SVG artifact

Verdict

visual sample

fail

0 artifact · 2/3 checks · fail

no failure labels

Prompt set v1_city_plan_svg.json

Run type api cheap

Temperature 0

Top P 1

Missed tasks 1/1

SVG Artifacts

0 artifact · 2/3 checks · fail

No parseable SVG files are available for this model. The visual run may exist, but the model did not return valid standalone SVG output.

Task Results

Compact view; open a row for prompt and raw answer

Task	Category	Score	Failed Checks	Failure Types	Prompt / Answer
city_plan_3d_buildings_svg	svg	2/3	valid_svg_basic	none	Inspect Prompt Generate a valid standalone SVG of a city plan with a 3D-style representation of buildings. Rules: - SVG only - no Markdown - no external images - no JavaScript - include roads or city blocks - include multiple buildings - make at least some buildings appear 3D or isometric - use simple vector shapes Model answer <?xml version="1.0" encoding="UTF-8"?> <svg width="600" height="400" xmlns="http://www.w3.org/2000/svg"> <!-- Roads and city blocks --> <rect x="50" y="50" width="500" height="20" fill="#8B4513"/> <rect x="50" y="80" width="20" height="300" fill="#8B4513"/> <rect x="150" y="80" width="20" height="300" fill="#8B4513"/> <rect x="250" y="80" width="20" height="300" fill="#8B4513"/> <rect x="350" y="80" width="20" height="300" fill="#8B4513"/> <rect x="450" y="80" width="20" height="300" fill="#8B4513"/> <!-- 3D-style buildings --> <!-- Building 1 --> <polygon points="100,50 120,20 140,20 140,50 120,80 100,80" fill="#A0522D"/> <polygon points="100,50 120,20 140,20 140,50 120,80 100,80" fill="#8B4513" stroke="#A0522D" stroke-width="2"/> <!-- Building 2 --> <polygon points="200,50 220,20 240,20 240,50 220,80 200,80" fill="#9370DB"/> <polygon points="200,50 220,20 240,20 240,50 220,80 200,80" fill="#8B4513" stroke="#9370DB" stroke-width="2"/> <!-- Building 3 --> <polygon points="300,50 320,20 340,20 340,50 320,80 300,80" fill="#4169E1"/> <polygon points="300,50 320,20 340,20 340,50 320,80 300,80" fill="#8B4513" stroke="#4169E1" stroke-width="2"/> <!-- Building 4 --> <polygon points="400,50 420,20 440,20 440,50 420,80 400,80" fill="#4682B4"/> <polygon points="400,50 420,20 440,20 440,50 420,80 400,80" fill="#8B4513" stroke="#4682B4" stroke-width="2"/> <!-- Building 5 --> <polygon points="500,50 520,20 540,20 540,50 520,80 500,80" fill="#6495ED"/> <polygon points="500,50 520,20 540,20 540,50 520,80 500,80" fill="#8B4513" stroke="#6495ED" stroke-width="2"/> </svg>

Task

Category

Score

Failed Checks

Failure Types

Prompt / Answer

city_plan_3d_buildings_svg

svg

2/3

valid_svg_basic

none

Inspect

Prompt

Generate a valid standalone SVG of a city plan with a 3D-style representation of buildings.

Rules:
- SVG only
- no Markdown
- no external images
- no JavaScript
- include roads or city blocks
- include multiple buildings
- make at least some buildings appear 3D or isometric
- use simple vector shapes

Model answer

<?xml version="1.0" encoding="UTF-8"?>
<svg width="600" height="400" xmlns="http://www.w3.org/2000/svg">
  <!-- Roads and city blocks -->
  <rect x="50" y="50" width="500" height="20" fill="#8B4513"/>
  <rect x="50" y="80" width="20" height="300" fill="#8B4513"/>
  <rect x="150" y="80" width="20" height="300" fill="#8B4513"/>
  <rect x="250" y="80" width="20" height="300" fill="#8B4513"/>
  <rect x="350" y="80" width="20" height="300" fill="#8B4513"/>
  <rect x="450" y="80" width="20" height="300" fill="#8B4513"/>

  <!-- 3D-style buildings -->
  <!-- Building 1 -->
  <polygon points="100,50 120,20 140,20 140,50 120,80 100,80" fill="#A0522D"/>
  <polygon points="100,50 120,20 140,20 140,50 120,80 100,80" fill="#8B4513" stroke="#A0522D" stroke-width="2"/>
  <!-- Building 2 -->
  <polygon points="200,50 220,20 240,20 240,50 220,80 200,80" fill="#9370DB"/>
  <polygon points="200,50 220,20 240,20 240,50 220,80 200,80" fill="#8B4513" stroke="#9370DB" stroke-width="2"/>
  <!-- Building 3 -->
  <polygon points="300,50 320,20 340,20 340,50 320,80 300,80" fill="#4169E1"/>
  <polygon points="300,50 320,20 340,20 340,50 320,80 300,80" fill="#8B4513" stroke="#4169E1" stroke-width="2"/>
  <!-- Building 4 -->
  <polygon points="400,50 420,20 440,20 440,50 420,80 400,80" fill="#4682B4"/>
  <polygon points="400,50 420,20 440,20 440,50 420,80 400,80" fill="#8B4513" stroke="#4682B4" stroke-width="2"/>
  <!-- Building 5 -->
  <polygon points="500,50 520,20 540,20 540,50 520,80 500,80" fill="#6495ED"/>
  <polygon points="500,50 520,20 540,20 540,50 520,80 500,80" fill="#8B4513" stroke="#6495ED" stroke-width="2"/>
</svg>