/hub/models/gemma4-12b-qat

Gemma 4 · 12B

Gemma 4 12B QAT

Gemma 4 12B QAT was the larger alternative in the Home SOC tests. Its timeouts, unfinished answers and incorrect counts remain in the results.

result records

Trevor-measured rows

test groups

devices represented

Why Gemma 4 12B QAT is in The Hub

Gemma 4 12B QAT was the larger alternative in the Home SOC tests. Its timeouts, unfinished answers and incorrect counts remain in the results.

A larger installed alternative tested through the same structured contract, not a general intelligence ranking.

The rows on this page use Structured report; default sampling, Written report; default sampling, Simulation logs; default sampling, and Structured report; shared sampling through Ollama 0.35.1. They describe those exact artifacts and runs, not every version that shares the model name.

What the recorded rows show

This record contains an outcome without a numeric generation result.

Compare inside the full test

The rows below can come from different prompts and methods. Open the full test before treating two numbers as a direct comparison.

Recorded results

Home SOC: Four Models with Default Sampling

Four models answered the same saved log summaries. This group contains two tasks: structured reports with a two-minute deadline, and written reports with a five-minute deadline. The sampling settings use each model's defaults.

Each model received 12 structured tasks three times and 6 written tasks twice. Repeats test consistency on those tasks; they are not new incidents. Compare completion and explanations within the same task and settings. These runs do not measure each model's best possible performance.

Gemma 4 12B QAT

Structured report; default sampling

Partial result

Measured on Minisforum MS-S1 MAX · CPU

Finished reports: 12 of 36; 12 fixed log summaries, each asked 3 times. A finished report completed within 120 seconds and passed the report validator. (answers)
Passed full answer checklist: 6 of 30; 10 summaries contain alerts, each asked 3 times. A pass needs a finished answer, expected explanations, valid list lengths, no repeated selections/citations and the required review priority. (answers)
Expected explanations selected: 6 of 63; 21 expected explanation items across those 10 summaries, repeated 3 times. This counts selected items, not whole answers or new discoveries. (selections)

24 requests exceeded the 120-second deadline. The full answer checklist is stricter than completion; failing it does not mean every part of the answer was wrong.

Setup and original evidence

Minisforum MS-S1 MAX · Ollama 0.35.1 · CPU · Native structured profile

Context window: 4,096 tokens for input and output together. CPU-thread setting: 2; this is a runtime setting, not the host's core count.

Installed artifact digest: 38044be4f923e5a55264ed7df4eaac2676651a905f735197c504045140c02bd3

Results and method Actual test host

Home SOC: Four Models with Default Sampling →

Gemma 4 12B QAT

Written report; default sampling

Partial result

Measured on Minisforum MS-S1 MAX · CPU

Finished reports: 8 of 12; 6 summaries with alerts, each asked twice. Only naturally finished answers count here. (answers)
Stopped at the output cap: 4 of 12; These answers returned text but reached the 700-token output limit before finishing. None of the written requests exceeded its 300-second deadline. (answers)
Finished answers with a major factual error: 2 of 8; One task produced a major factual error, repeated in both answers. Repeating it twice is not two different incidents. (answers)

The model claimed 14 allowed events where the supplied summary contained 15 and described traffic as routine/internal without enough evidence. That error repeated twice; unfinished answers were withheld.

Setup and original evidence

Minisforum MS-S1 MAX · Ollama 0.35.1 · CPU · Native written profile

Context window: 4,096 tokens for input and output together. CPU-thread setting: 2; this is a runtime setting, not the host's core count.

Installed artifact digest: 38044be4f923e5a55264ed7df4eaac2676651a905f735197c504045140c02bd3

Results and method Actual test host

Home SOC: Four Models with Default Sampling →

Home SOC: Models Reading Simulation Logs

I converted the simulation logs into summaries, then asked each model to review them twice. Some simulations produced no alerts, so completion across all requests is shown separately from explanations on the summaries that contain alerts.

21 source cases produced 9 different summaries: 8 with alerts and 1 empty summary shared by 13 sources. Each model made 42 requests, but only 16 were the alert-bearing tasks (8 summaries, twice). Those repeats and duplicate empty inputs do not represent 42 different incidents.

Gemma 4 12B QAT

Simulation logs; default sampling

Partial result

Measured on Minisforum MS-S1 MAX · CPU

Finished reports: 40 of 42; 21 source cases, each asked twice. 13 sources produced the same empty summary, so this total includes duplicate inputs. (answers)
All expected explanations shown: 14 of 16; 8 different summaries contain alerts, each asked twice. An answer counts only when every expected explanation is visible in the rendered report. (answers)
Passed full answer checklist: 14 of 16; The same 16 alert-bearing attempts. The unedited answer must meet explanation, list-length, repetition and review-priority checks as well as finish. (answers)

Completion across all requests includes the empty summaries. Read the explanation and checklist counts for the 16 attempts with alerts. Identical repeated answers reused their source-linked agent review after exact identity checks.

Setup and original evidence

Minisforum MS-S1 MAX · Ollama 0.35.1 · CPU · Native simulation-source profile

Context window: 4,096 tokens for input and output together. CPU-thread setting: 2; this is a runtime setting, not the host's core count.

Installed artifact digest: 38044be4f923e5a55264ed7df4eaac2676651a905f735197c504045140c02bd3

Results and method Actual test host

Home SOC: Models Reading Simulation Logs →

Home SOC: Four Models with Shared Sampling

Each model answered the same 12 tasks once with the sampling settings made explicit. Read completion first, then check whether the alert explanations and full answer checklist passed.

10 of the 12 tasks contain alerts. Completion uses all 12; explanation and checklist results use those 10. The 21 expected explanations count individual items across the same 10 tasks. This pass supports a choice for the scheduled report under these settings, not a general intelligence ranking.

Gemma 4 12B QAT

Structured report; shared sampling

Partial result

Measured on Minisforum MS-S1 MAX · CPU

Finished reports: 4 of 12; 12 fixed summaries asked once; 2 have no alerts. A report must finish within 120 seconds and pass the report validator. (answers)
All expected explanations shown: 2 of 10; 10 of those summaries contain alerts. Each pass means all expected explanations appear in the rendered report. (answers)
Passed full answer checklist: 2 of 10; The same 10 alert-bearing tasks. A pass also requires a finished answer, valid list lengths, no repeated selections/citations and the required review priority, before display cleanup. (answers)
Expected explanations selected: 2 of 21; 21 individual explanation items across the same 10 tasks. This is an item count, not 21 cases. (selections)

8 requests timed out. Of the 10 tasks with alerts, 2 showed every expected explanation and 2 met the full answer checklist. The 2/21 count tracks individual explanation items within those same tasks.

Setup and original evidence

Minisforum MS-S1 MAX · Ollama 0.35.1 · CPU · Explicit common profile

Context window: 4,096 tokens for input and output together. CPU-thread setting: 2; this is a runtime setting, not the host's core count.

Installed artifact digest: 38044be4f923e5a55264ed7df4eaac2676651a905f735197c504045140c02bd3

Results and method Actual test host

Home SOC: Four Models with Shared Sampling →

Full tests containing Gemma 4 12B QAT

2026-10-06

Home SOC: Four Models with Default Sampling

Open full test

2026-10-06

Home SOC: Models Reading Simulation Logs

Open full test

2026-10-06

Home SOC: Four Models with Shared Sampling

Open full test