Gemma 4 31B: dense model, brittle closure
Gemma 4 31B is positioned as the dense, all-parameters-active sibling of the Gemma 4 family. It often understood the broad document situation, but the strict benchmark contract punished it hard.
The dense 31B run is useful because it breaks a simple assumption: larger local model, better workflow result. The model is listed as the dense Gemma 4 counterpart, with all parameters active during inference and support for vision, structured output, and agentic workflows.
On this benchmark, that did not translate into clean closure. The model reached core-pass level often enough to show understanding, but exact final artifacts, proof codes, and evidence formatting kept it from resolving any case strictly.
Where it worked
- Reached core-pass level on five cases despite resolving none strictly.
- Produced a valid City Plan SVG sample.
- Often got the broad document situation, but lost the exact benchmark contract.
Where it failed
- No strict resolved cases in the current run.
- Format, evidence, and exact artifact expectations caused many failures.
- The result is a reminder that larger local models can still be brittle in constrained workflows.