/hub

The Hub

Local AI Benchmarks, Inference Results, and Hardware Testing

The results outgrew the articles. At some point, another wall of bash output stopped being useful. The Hub puts the individual runs, hardware, model files, speeds, thermals, failures, and source material in one place. Now you can search by device or model and pull up the numbers, test settings, compatibility results, and evidence behind each run.

What am I looking at?

The Hub collects results from my different builds. A test group holds one question and its settings; a result row holds one model, configuration or stage of that test. Some rows are averages from repeated requests, while others count completed answers or show a temperature. The full test page explains which one you are reading.

I prepare these records from saved test outputs and reports, then include them in the website. This page does not collect live firewall traffic or combine the results into an overall model ranking.

Inference performance

Generation and prompt processing are measured in tokens per second. Check the model file, runtime and workload before comparing two rows.

Home SOC model tests

These count finished reports, expected explanations and evidence checks. The models ran on the MS-S1 MAX; the Protectli Vault supplied the firewall events. These are separate from the MS-S1 knowledge-assistant and fine-tuning project.

Hardware and setup checks

The Vault pages separate physical blocking, virtual packet checks, offline replays, path measurements, thermals and evidence recovery. The GPU report belongs to the Minisforum and checks Radeon offload. Each page names the system and the scope of its test.

For example, Qwen3.5 4B finished 12 of 12 reports with shared settings. Of the 10 tasks containing alerts, 7 showed every expected explanation and 4 passed the full answer checklist. Those numbers describe different checks on the same tasks.

122
result rows
88
published rows
9
rows labeled failed
21
test groups
122
matching now

These counts describe Hub rows. A row can summarize several requests or samples; the denominator on each measurement tells you what was counted. The Hub does not combine them into one accuracy score.

Find a result

Search model notes, devices, runtime versions, failures, or supporting filenames. Try “Qwen3.5 9B”, “inference speed”, or “matched-runtime-summary.csv”.

122 matching result rows.

Start with the test group: compare the same task and settings before drawing a conclusion. Tokens per second, finished reports, investigation checks and temperatures measure different things. The Vault pages hold firewall and supporting workflow checks; model experiments belong to the Minisforum.

Inference performance

Rates measure prompt processing and generation. Open a row to see its workload, repetitions and setup.

Model and artifactRuntime and modeGenerationPromptPeakStateFull test
Qwen3 0.6B
Q4_K_M
llama.cpp 9a286ac
CPU · Matched server request
6.725 tok/s10.48 tok/s81 °CPublished resultMatched CPU runtimes
Open result details

About this model

Qwen3 0.6B is the smallest Qwen3 model in these tests. The 0.6B label describes its parameter count; Q4_K_M identifies the quantized file I ran. Its small size made it a useful starting point for testing CPU inference and Intel GPU offload on the X1S.

Family
Qwen3
Recorded size
0.6B

It was small enough to show the CPU, mixed host-operation, and full-Vulkan differences without crossing into the larger-model i915 failures.

What ran

Q4_K_M ran through llama.cpp 9a286ac using CPU in Matched server request mode on Youyeetoo X1S.

Three measured requests completed with a clean kernel window.

Internal generation rates are comparable inside this eight-row test. Model load time was not an identical part of the timed path.

Methods and supporting files

  • Matched result table

    Prompt and generation rates, standard deviation, token counts, model hashes, repetitions, and package peaks.

    matched-runtime-summary.csv
  • Runtime comparison

    Build record, matched method, timing boundary, and result interpretation.

    RUNTIME_COMPARISON.md
  • Retest protocol

    Shared controls, safety limits, and the distinction between CPU runtime and Vulkan tests.

    MATCHED_RETEST_PROTOCOL.md

Recorded setup

Threads
4
Context
4,096 tokens
Prompt
71 tokens
Output
96 tokens
Batch
512 / 512 microbatch
Measured runs
3
Generation stddev
0.014215
Thermal ceiling
85 °C

Artifact SHA-2567f4030143c1c477224c5434f8272c662a8b042079a0a584f0a27a1684fe2e1fa

Qwen3 0.6B
Q4_K_M
Ollama 0.32.1
CPU · Matched server request
7.809 tok/s13.24 tok/s81 °CPublished resultMatched CPU runtimes
Open result details

About this model

Qwen3 0.6B is the smallest Qwen3 model in these tests. The 0.6B label describes its parameter count; Q4_K_M identifies the quantized file I ran. Its small size made it a useful starting point for testing CPU inference and Intel GPU offload on the X1S.

Family
Qwen3
Recorded size
0.6B

It was small enough to show the CPU, mixed host-operation, and full-Vulkan differences without crossing into the larger-model i915 failures.

What ran

Q4_K_M ran through Ollama 0.32.1 using CPU in Matched server request mode on Youyeetoo X1S.

Ollama reported 16.11% higher internal generation throughput than the paired llama.cpp row.

Internal generation rates are comparable inside this eight-row test. Model load time was not an identical part of the timed path.

Methods and supporting files

  • Matched result table

    Prompt and generation rates, standard deviation, token counts, model hashes, repetitions, and package peaks.

    matched-runtime-summary.csv
  • Runtime comparison

    Build record, matched method, timing boundary, and result interpretation.

    RUNTIME_COMPARISON.md
  • Retest protocol

    Shared controls, safety limits, and the distinction between CPU runtime and Vulkan tests.

    MATCHED_RETEST_PROTOCOL.md

Recorded setup

Threads
4
Context
4,096 tokens
Prompt
71 tokens
Output
96 tokens
Batch
512 / 512 microbatch
Measured runs
3
Generation stddev
0.094756
Thermal ceiling
85 °C

Artifact SHA-2567f4030143c1c477224c5434f8272c662a8b042079a0a584f0a27a1684fe2e1fa

Qwen3 1.7B
Q4_K_M
llama.cpp 9a286ac
CPU · Matched server request
2.852 tok/s3.849 tok/s83 °CPublished resultMatched CPU runtimes
Open result details

About this model

Qwen3 1.7B is the next step up from the 0.6B model in the matched X1S tests. I used the Q4_K_M file in both CPU servers, then ran the same model through the three llama.cpp device modes. The two groups answer different questions, so their results are listed separately.

Family
Qwen3
Recorded size
1.7B

The original X1S work put it in the usable interactive tier, so it became the second clean model for checking whether the Vulkan pattern held beyond 0.6B.

What ran

Q4_K_M ran through llama.cpp 9a286ac using CPU in Matched server request mode on Youyeetoo X1S.

Three measured requests completed with a clean kernel window.

Internal generation rates are comparable inside this eight-row test. Model load time was not an identical part of the timed path.

Methods and supporting files

  • Matched result table

    Prompt and generation rates, standard deviation, token counts, model hashes, repetitions, and package peaks.

    matched-runtime-summary.csv
  • Runtime comparison

    Build record, matched method, timing boundary, and result interpretation.

    RUNTIME_COMPARISON.md
  • Retest protocol

    Shared controls, safety limits, and the distinction between CPU runtime and Vulkan tests.

    MATCHED_RETEST_PROTOCOL.md

Recorded setup

Threads
4
Context
4,096 tokens
Prompt
71 tokens
Output
96 tokens
Batch
512 / 512 microbatch
Measured runs
3
Generation stddev
0.002042
Thermal ceiling
85 °C

Artifact SHA-2563d0b790534fe4b79525fc3692950408dca41171676ed7e21db57af5c65ef6ab6

Qwen3 1.7B
Q4_K_M
Ollama 0.32.1
CPU · Matched server request
3.321 tok/s5.075 tok/s83 °CPublished resultMatched CPU runtimes
Open result details

About this model

Qwen3 1.7B is the next step up from the 0.6B model in the matched X1S tests. I used the Q4_K_M file in both CPU servers, then ran the same model through the three llama.cpp device modes. The two groups answer different questions, so their results are listed separately.

Family
Qwen3
Recorded size
1.7B

The original X1S work put it in the usable interactive tier, so it became the second clean model for checking whether the Vulkan pattern held beyond 0.6B.

What ran

Q4_K_M ran through Ollama 0.32.1 using CPU in Matched server request mode on Youyeetoo X1S.

Ollama reported 16.46% higher internal generation throughput than the paired llama.cpp row.

Internal generation rates are comparable inside this eight-row test. Model load time was not an identical part of the timed path.

Methods and supporting files

  • Matched result table

    Prompt and generation rates, standard deviation, token counts, model hashes, repetitions, and package peaks.

    matched-runtime-summary.csv
  • Runtime comparison

    Build record, matched method, timing boundary, and result interpretation.

    RUNTIME_COMPARISON.md
  • Retest protocol

    Shared controls, safety limits, and the distinction between CPU runtime and Vulkan tests.

    MATCHED_RETEST_PROTOCOL.md

Recorded setup

Threads
4
Context
4,096 tokens
Prompt
71 tokens
Output
96 tokens
Batch
512 / 512 microbatch
Measured runs
3
Generation stddev
0.012057
Thermal ceiling
85 °C

Artifact SHA-2563d0b790534fe4b79525fc3692950408dca41171676ed7e21db57af5c65ef6ab6

Qwen3 4B Instruct
Q4_K_M
llama.cpp 9a286ac
CPU · Matched server request
1.484 tok/s1.899 tok/s81 °CPublished resultMatched CPU runtimes
Open result details

About this model

This is the instruction-tuned 4B Qwen3 entry. It appears in the X1S inference tests and the Home SOC reporting work on the Minisforum. The model name connects those records, while the file, hardware and settings on each row tell you which configuration actually ran.

Family
Qwen3
Recorded size
4B

It marks the point where the clean small-model Vulkan result stopped scaling into a reliable larger-model run on this software stack.

What ran

Q4_K_M ran through llama.cpp 9a286ac using CPU in Matched server request mode on Youyeetoo X1S.

Three measured requests completed with a clean kernel window.

Internal generation rates are comparable inside this eight-row test. Model load time was not an identical part of the timed path.

Methods and supporting files

  • Matched result table

    Prompt and generation rates, standard deviation, token counts, model hashes, repetitions, and package peaks.

    matched-runtime-summary.csv
  • Runtime comparison

    Build record, matched method, timing boundary, and result interpretation.

    RUNTIME_COMPARISON.md
  • Retest protocol

    Shared controls, safety limits, and the distinction between CPU runtime and Vulkan tests.

    MATCHED_RETEST_PROTOCOL.md

Recorded setup

Threads
4
Context
4,096 tokens
Prompt
71 tokens
Output
96 tokens
Batch
512 / 512 microbatch
Measured runs
3
Generation stddev
0.000599
Thermal ceiling
85 °C

Artifact SHA-25685e4a5b7b8ef0e48af0e8658f5aaab9c2324c76c1641493f4d1e25fce54b18b9

Qwen3 4B Instruct
Q4_K_M
Ollama 0.32.1
CPU · Matched server request
2.002 tok/s2.789 tok/s81 °CPublished resultMatched CPU runtimes
Open result details

About this model

This is the instruction-tuned 4B Qwen3 entry. It appears in the X1S inference tests and the Home SOC reporting work on the Minisforum. The model name connects those records, while the file, hardware and settings on each row tell you which configuration actually ran.

Family
Qwen3
Recorded size
4B

It marks the point where the clean small-model Vulkan result stopped scaling into a reliable larger-model run on this software stack.

What ran

Q4_K_M ran through Ollama 0.32.1 using CPU in Matched server request mode on Youyeetoo X1S.

Ollama reported 34.89% higher internal generation throughput than the paired llama.cpp row.

Internal generation rates are comparable inside this eight-row test. Model load time was not an identical part of the timed path.

Methods and supporting files

  • Matched result table

    Prompt and generation rates, standard deviation, token counts, model hashes, repetitions, and package peaks.

    matched-runtime-summary.csv
  • Runtime comparison

    Build record, matched method, timing boundary, and result interpretation.

    RUNTIME_COMPARISON.md
  • Retest protocol

    Shared controls, safety limits, and the distinction between CPU runtime and Vulkan tests.

    MATCHED_RETEST_PROTOCOL.md

Recorded setup

Threads
4
Context
4,096 tokens
Prompt
71 tokens
Output
96 tokens
Batch
512 / 512 microbatch
Measured runs
3
Generation stddev
0.033289
Thermal ceiling
85 °C

Artifact SHA-25685e4a5b7b8ef0e48af0e8658f5aaab9c2324c76c1641493f4d1e25fce54b18b9

Phi-4 Mini
Q4_K_M
llama.cpp 9a286ac
CPU · Matched server request
1.57 tok/s2.115 tok/s82 °CPublished resultMatched CPU runtimes
Open result details

About this model

Phi-4 Mini gave me a second model family for the matched CPU test. Both runtimes loaded the Q4_K_M file, so I could compare the same workload beyond the Qwen models. Its later Vulkan failure belongs to the GPU test, not the completed CPU comparison.

Family
Phi-4
Recorded size
Mini

It provides a second model family inside the matched runtime result and a retained failure outside the clean Vulkan pair.

What ran

Q4_K_M ran through llama.cpp 9a286ac using CPU in Matched server request mode on Youyeetoo X1S.

Three measured requests completed with a clean kernel window.

Internal generation rates are comparable inside this eight-row test. Model load time was not an identical part of the timed path.

Methods and supporting files

  • Matched result table

    Prompt and generation rates, standard deviation, token counts, model hashes, repetitions, and package peaks.

    matched-runtime-summary.csv
  • Runtime comparison

    Build record, matched method, timing boundary, and result interpretation.

    RUNTIME_COMPARISON.md
  • Retest protocol

    Shared controls, safety limits, and the distinction between CPU runtime and Vulkan tests.

    MATCHED_RETEST_PROTOCOL.md

Recorded setup

Threads
4
Context
4,096 tokens
Prompt
70 tokens
Output
96 tokens
Batch
512 / 512 microbatch
Measured runs
3
Generation stddev
0.000531
Thermal ceiling
85 °C

Artifact SHA-2563c168af1dea0a414299c7d9077e100ac763370e5a98b3c53801a958a47f0a5db

Phi-4 Mini
Q4_K_M
Ollama 0.32.1
CPU · Matched server request
2.072 tok/s3.131 tok/s82 °CPublished resultMatched CPU runtimes
Open result details

About this model

Phi-4 Mini gave me a second model family for the matched CPU test. Both runtimes loaded the Q4_K_M file, so I could compare the same workload beyond the Qwen models. Its later Vulkan failure belongs to the GPU test, not the completed CPU comparison.

Family
Phi-4
Recorded size
Mini

It provides a second model family inside the matched runtime result and a retained failure outside the clean Vulkan pair.

What ran

Q4_K_M ran through Ollama 0.32.1 using CPU in Matched server request mode on Youyeetoo X1S.

Ollama reported 32.00% higher internal generation throughput than the paired llama.cpp row.

Internal generation rates are comparable inside this eight-row test. Model load time was not an identical part of the timed path.

Methods and supporting files

  • Matched result table

    Prompt and generation rates, standard deviation, token counts, model hashes, repetitions, and package peaks.

    matched-runtime-summary.csv
  • Runtime comparison

    Build record, matched method, timing boundary, and result interpretation.

    RUNTIME_COMPARISON.md
  • Retest protocol

    Shared controls, safety limits, and the distinction between CPU runtime and Vulkan tests.

    MATCHED_RETEST_PROTOCOL.md

Recorded setup

Threads
4
Context
4,096 tokens
Prompt
70 tokens
Output
96 tokens
Batch
512 / 512 microbatch
Measured runs
3
Generation stddev
0.009724
Thermal ceiling
85 °C

Artifact SHA-2563c168af1dea0a414299c7d9077e100ac763370e5a98b3c53801a958a47f0a5db

Qwen3 0.6B
Q4_K_M
llama.cpp 9a286ac
CPU · True CPU
7.397 tok/s10.67 tok/s81 °CPublished resultCPU and Vulkan modes
Open result details

About this model

Qwen3 0.6B is the smallest Qwen3 model in these tests. The 0.6B label describes its parameter count; Q4_K_M identifies the quantized file I ran. Its small size made it a useful starting point for testing CPU inference and Intel GPU offload on the X1S.

Family
Qwen3
Recorded size
0.6B

It was small enough to show the CPU, mixed host-operation, and full-Vulkan differences without crossing into the larger-model i915 failures.

What ran

Q4_K_M ran through llama.cpp 9a286ac using CPU in True CPU mode on Youyeetoo X1S.

Vulkan was hidden and host-operation offload was disabled. The five-repetition run had a clean kernel window.

Compare the clean Qwen rows inside this group. The larger-model entries are failure outcomes, not performance rows.

Methods and supporting files

  • Three-mode result table

    True CPU, mixed host-operation, and full-Vulkan rates and package peaks.

    three-mode-summary.csv
  • Matched retest results

    The clean small-model result and retained larger-model i915 failures.

    MATCHED_RETEST_RESULTS.md
  • Device-mode protocol

    How the three modes were separated and guarded.

    MATCHED_RETEST_PROTOCOL.md

Recorded setup

Threads
4
Prompt
128 tokens
Output
96 tokens
Batch
512 / 512 microbatch
Measured runs
5
Thermal ceiling
85 °C
Qwen3 0.6B
Q4_K_M
llama.cpp 9a286ac
CPU + GPU · Mixed host operations
7.425 tok/s34.59 tok/s80 °CPublished resultCPU and Vulkan modes
Open result details

About this model

Qwen3 0.6B is the smallest Qwen3 model in these tests. The 0.6B label describes its parameter count; Q4_K_M identifies the quantized file I ran. Its small size made it a useful starting point for testing CPU inference and Intel GPU offload on the X1S.

Family
Qwen3
Recorded size
0.6B

It was small enough to show the CPU, mixed host-operation, and full-Vulkan differences without crossing into the larger-model i915 failures.

What ran

Q4_K_M ran through llama.cpp 9a286ac using CPU + GPU in Mixed host operations mode on Youyeetoo X1S.

Zero model layers still allowed host operations on the Intel GPU. Prompt processing rose sharply while generation barely moved.

Compare the clean Qwen rows inside this group. The larger-model entries are failure outcomes, not performance rows.

Methods and supporting files

  • Three-mode result table

    True CPU, mixed host-operation, and full-Vulkan rates and package peaks.

    three-mode-summary.csv
  • Matched retest results

    The clean small-model result and retained larger-model i915 failures.

    MATCHED_RETEST_RESULTS.md
  • Device-mode protocol

    How the three modes were separated and guarded.

    MATCHED_RETEST_PROTOCOL.md

Recorded setup

Threads
4
Prompt
128 tokens
Output
96 tokens
Batch
512 / 512 microbatch
Measured runs
5
Thermal ceiling
85 °C
Qwen3 0.6B
Q4_K_M
llama.cpp 9a286ac
Vulkan · Full Vulkan
8.593 tok/s37.35 tok/s57 °CPublished resultCPU and Vulkan modes
Open result details

About this model

Qwen3 0.6B is the smallest Qwen3 model in these tests. The 0.6B label describes its parameter count; Q4_K_M identifies the quantized file I ran. Its small size made it a useful starting point for testing CPU inference and Intel GPU offload on the X1S.

Family
Qwen3
Recorded size
0.6B

It was small enough to show the CPU, mixed host-operation, and full-Vulkan differences without crossing into the larger-model i915 failures.

What ran

Q4_K_M ran through llama.cpp 9a286ac using Vulkan in Full Vulkan mode on Youyeetoo X1S.

Full Vulkan improved generation 16.2% over true CPU and cut the recorded package peak by 24 °C.

Compare the clean Qwen rows inside this group. The larger-model entries are failure outcomes, not performance rows.

Methods and supporting files

  • Three-mode result table

    True CPU, mixed host-operation, and full-Vulkan rates and package peaks.

    three-mode-summary.csv
  • Matched retest results

    The clean small-model result and retained larger-model i915 failures.

    MATCHED_RETEST_RESULTS.md
  • Device-mode protocol

    How the three modes were separated and guarded.

    MATCHED_RETEST_PROTOCOL.md

Recorded setup

Threads
4
Prompt
128 tokens
Output
96 tokens
Batch
512 / 512 microbatch
Measured runs
5
Thermal ceiling
85 °C
Qwen3 1.7B
Q4_K_M
llama.cpp 9a286ac
CPU · True CPU
2.986 tok/s3.893 tok/s84 °CPublished resultCPU and Vulkan modes
Open result details

About this model

Qwen3 1.7B is the next step up from the 0.6B model in the matched X1S tests. I used the Q4_K_M file in both CPU servers, then ran the same model through the three llama.cpp device modes. The two groups answer different questions, so their results are listed separately.

Family
Qwen3
Recorded size
1.7B

The original X1S work put it in the usable interactive tier, so it became the second clean model for checking whether the Vulkan pattern held beyond 0.6B.

What ran

Q4_K_M ran through llama.cpp 9a286ac using CPU in True CPU mode on Youyeetoo X1S.

Vulkan was hidden and host-operation offload was disabled. The five-repetition run had a clean kernel window.

Compare the clean Qwen rows inside this group. The larger-model entries are failure outcomes, not performance rows.

Methods and supporting files

  • Three-mode result table

    True CPU, mixed host-operation, and full-Vulkan rates and package peaks.

    three-mode-summary.csv
  • Matched retest results

    The clean small-model result and retained larger-model i915 failures.

    MATCHED_RETEST_RESULTS.md
  • Device-mode protocol

    How the three modes were separated and guarded.

    MATCHED_RETEST_PROTOCOL.md

Recorded setup

Threads
4
Prompt
128 tokens
Output
96 tokens
Batch
512 / 512 microbatch
Measured runs
5
Thermal ceiling
85 °C
Qwen3 1.7B
Q4_K_M
llama.cpp 9a286ac
CPU + GPU · Mixed host operations
2.997 tok/s12.37 tok/s83 °CPublished resultCPU and Vulkan modes
Open result details

About this model

Qwen3 1.7B is the next step up from the 0.6B model in the matched X1S tests. I used the Q4_K_M file in both CPU servers, then ran the same model through the three llama.cpp device modes. The two groups answer different questions, so their results are listed separately.

Family
Qwen3
Recorded size
1.7B

The original X1S work put it in the usable interactive tier, so it became the second clean model for checking whether the Vulkan pattern held beyond 0.6B.

What ran

Q4_K_M ran through llama.cpp 9a286ac using CPU + GPU in Mixed host operations mode on Youyeetoo X1S.

Zero model layers still allowed host operations on the Intel GPU. Prompt processing rose sharply while generation barely moved.

Compare the clean Qwen rows inside this group. The larger-model entries are failure outcomes, not performance rows.

Methods and supporting files

  • Three-mode result table

    True CPU, mixed host-operation, and full-Vulkan rates and package peaks.

    three-mode-summary.csv
  • Matched retest results

    The clean small-model result and retained larger-model i915 failures.

    MATCHED_RETEST_RESULTS.md
  • Device-mode protocol

    How the three modes were separated and guarded.

    MATCHED_RETEST_PROTOCOL.md

Recorded setup

Threads
4
Prompt
128 tokens
Output
96 tokens
Batch
512 / 512 microbatch
Measured runs
5
Thermal ceiling
85 °C
Qwen3 1.7B
Q4_K_M
llama.cpp 9a286ac
Vulkan · Full Vulkan
3.462 tok/s12.88 tok/s58 °CPublished resultCPU and Vulkan modes
Open result details

About this model

Qwen3 1.7B is the next step up from the 0.6B model in the matched X1S tests. I used the Q4_K_M file in both CPU servers, then ran the same model through the three llama.cpp device modes. The two groups answer different questions, so their results are listed separately.

Family
Qwen3
Recorded size
1.7B

The original X1S work put it in the usable interactive tier, so it became the second clean model for checking whether the Vulkan pattern held beyond 0.6B.

What ran

Q4_K_M ran through llama.cpp 9a286ac using Vulkan in Full Vulkan mode on Youyeetoo X1S.

Full Vulkan improved generation 15.9% over true CPU and cut the recorded package peak by 26 °C.

Compare the clean Qwen rows inside this group. The larger-model entries are failure outcomes, not performance rows.

Methods and supporting files

  • Three-mode result table

    True CPU, mixed host-operation, and full-Vulkan rates and package peaks.

    three-mode-summary.csv
  • Matched retest results

    The clean small-model result and retained larger-model i915 failures.

    MATCHED_RETEST_RESULTS.md
  • Device-mode protocol

    How the three modes were separated and guarded.

    MATCHED_RETEST_PROTOCOL.md

Recorded setup

Threads
4
Prompt
128 tokens
Output
96 tokens
Batch
512 / 512 microbatch
Measured runs
5
Thermal ceiling
85 °C
Qwen3 4B
Q4_K_M
llama.cpp 9a286ac
Vulkan · Full Vulkan
n/an/an/aFailed runCPU and Vulkan modes
Open result details

About this model

This is the instruction-tuned 4B Qwen3 entry. It appears in the X1S inference tests and the Home SOC reporting work on the Minisforum. The model name connects those records, while the file, hardware and settings on each row tell you which configuration actually ran.

Family
Qwen3
Recorded size
4B

It marks the point where the clean small-model Vulkan result stopped scaling into a reliable larger-model run on this software stack.

What ran

Q4_K_M ran through llama.cpp 9a286ac using Vulkan in Full Vulkan mode on Youyeetoo X1S.

The run reached an i915 reset timeout. No speed score is published for it.

Compare the clean Qwen rows inside this group. The larger-model entries are failure outcomes, not performance rows.

Methods and supporting files

  • Three-mode result table

    True CPU, mixed host-operation, and full-Vulkan rates and package peaks.

    three-mode-summary.csv
  • Matched retest results

    The clean small-model result and retained larger-model i915 failures.

    MATCHED_RETEST_RESULTS.md
  • Device-mode protocol

    How the three modes were separated and guarded.

    MATCHED_RETEST_PROTOCOL.md

Recorded setup

The full test page contains the shared controls and comparison boundary for this row.

Phi-4 Mini
Q4_K_M
llama.cpp 9a286ac
Vulkan · Full Vulkan
n/an/an/aFailed runCPU and Vulkan modes
Open result details

About this model

Phi-4 Mini gave me a second model family for the matched CPU test. Both runtimes loaded the Q4_K_M file, so I could compare the same workload beyond the Qwen models. Its later Vulkan failure belongs to the GPU test, not the completed CPU comparison.

Family
Phi-4
Recorded size
Mini

It provides a second model family inside the matched runtime result and a retained failure outside the clean Vulkan pair.

What ran

Q4_K_M ran through llama.cpp 9a286ac using Vulkan in Full Vulkan mode on Youyeetoo X1S.

The run window contained an i915 GPU hang even though llama-bench returned zero. The kernel event overrides the process exit code.

Compare the clean Qwen rows inside this group. The larger-model entries are failure outcomes, not performance rows.

Methods and supporting files

  • Three-mode result table

    True CPU, mixed host-operation, and full-Vulkan rates and package peaks.

    three-mode-summary.csv
  • Matched retest results

    The clean small-model result and retained larger-model i915 failures.

    MATCHED_RETEST_RESULTS.md
  • Device-mode protocol

    How the three modes were separated and guarded.

    MATCHED_RETEST_PROTOCOL.md

Recorded setup

The full test page contains the shared controls and comparison boundary for this row.

Qwen3 8B
Q4_K_M
llama.cpp 9a286ac
Vulkan · Full Vulkan
n/an/an/aFailed runCPU and Vulkan modes
Open result details

About this model

The 8B Qwen3 entry was useful for testing the upper end of what I could run on the 16 GB X1S. Loading and completing a CPU request was one result; the larger full-Vulkan attempt was a separate test with its own failure record.

Family
Qwen3
Recorded size
8B

It establishes that fitting in 16 GB and completing on CPU did not guarantee a stable full-GPU path.

What ran

Q4_K_M ran through llama.cpp 9a286ac using Vulkan in Full Vulkan mode on Youyeetoo X1S.

The run window contained an i915 GPU hang even though llama-bench returned zero. No clean performance row is claimed.

Compare the clean Qwen rows inside this group. The larger-model entries are failure outcomes, not performance rows.

Methods and supporting files

  • Three-mode result table

    True CPU, mixed host-operation, and full-Vulkan rates and package peaks.

    three-mode-summary.csv
  • Matched retest results

    The clean small-model result and retained larger-model i915 failures.

    MATCHED_RETEST_RESULTS.md
  • Device-mode protocol

    How the three modes were separated and guarded.

    MATCHED_RETEST_PROTOCOL.md

Recorded setup

The full test page contains the shared controls and comparison boundary for this row.

Gemma 3 4B
Text-only derivative
llama.cpp 9a286ac
Vulkan · Full Vulkan
n/an/an/aFailed runCPU and Vulkan modes
Open result details

About this model

The Gemma 3 entry includes a separate text-only derivative made from the original artifact. That distinction matters when reproducing the run: the derivative completed true CPU, while the later Vulkan attempt still hit the device-loss path. Keep the file identity with the result.

Family
Gemma 3
Recorded size
4B

It records two different compatibility boundaries: converting the older multimodal artifact for current llama.cpp and the separate Vulkan failure that conversion did not fix.

What ran

Text-only derivative ran through llama.cpp 9a286ac using Vulkan in Full Vulkan mode on Youyeetoo X1S.

Fence and preemption timeouts led to an i915 reset and vk::DeviceLostError.

Compare the clean Qwen rows inside this group. The larger-model entries are failure outcomes, not performance rows.

Methods and supporting files

  • Three-mode result table

    True CPU, mixed host-operation, and full-Vulkan rates and package peaks.

    three-mode-summary.csv
  • Matched retest results

    The clean small-model result and retained larger-model i915 failures.

    MATCHED_RETEST_RESULTS.md
  • Device-mode protocol

    How the three modes were separated and guarded.

    MATCHED_RETEST_PROTOCOL.md

Recorded setup

The full test page contains the shared controls and comparison boundary for this row.

Ling-mini-2.0
IQ4_XS, pinned revision 8be84a0
llama.cpp 9a286ac
CPU · 3 threads, 85 °C guard
3.091 tok/s4.375 tok/s74 °CPublished resultLing-mini thread test
Open result details

About this model

Ling-mini-2.0 is listed as 16B total parameters with 3B active. For this test I pinned one 8.8 GB IQ4_XS file, then changed the CPU thread count. The model page keeps the three- and four-thread settings, repetitions and thermal limits beside their results.

Family
Ling-mini
Recorded size
16B total / 3B active

The thread test shows a real speed and temperature tradeoff on the N5095 using one verified 8.8 GB artifact rather than a mutable model tag.

What ran

IQ4_XS, pinned revision 8be84a0 ran through llama.cpp 9a286ac using CPU in 3 threads, 85 °C guard mode on Youyeetoo X1S.

The clean three-thread row stayed well below the normal thermal guard.

The four-thread row used a disclosed 90 °C abort after the first attempt reached the normal 85 °C guard.

Methods and supporting files

  • Ling result table

    Exact revision, file hash and size, repetitions, standard deviation, thermal limits, and selected row.

    ling-mini-iq4-xs-summary.csv
  • Ling method

    Artifact identity, true-CPU workload, and the disclosed thermal repeat.

    MATCHED_RETEST_PROTOCOL.md

Recorded setup

Threads
3
Prompt
128 tokens
Output
96 tokens
Measured runs
5
Generation stddev
0.001523
Thermal ceiling
85 °C
Source revision
8be84a0f4727

Artifact SHA-256a72d86d4cb4fedd940e34c08d008bb5cda42db80ce5c6bc5f9494e854a3d742d

Ling-mini-2.0
IQ4_XS, pinned revision 8be84a0
llama.cpp 9a286ac
CPU · 4 threads, 90 °C guard
4.083 tok/s5.817 tok/s85 °CPublished resultLing-mini thread test
Open result details

About this model

Ling-mini-2.0 is listed as 16B total parameters with 3B active. For this test I pinned one 8.8 GB IQ4_XS file, then changed the CPU thread count. The model page keeps the three- and four-thread settings, repetitions and thermal limits beside their results.

Family
Ling-mini
Recorded size
16B total / 3B active

The thread test shows a real speed and temperature tradeoff on the N5095 using one verified 8.8 GB artifact rather than a mutable model tag.

What ran

IQ4_XS, pinned revision 8be84a0 ran through llama.cpp 9a286ac using CPU in 4 threads, 90 °C guard mode on Youyeetoo X1S.

The selected four-thread row improved generation 32.1% and completed under the disclosed 90 °C ceiling.

The four-thread row used a disclosed 90 °C abort after the first attempt reached the normal 85 °C guard.

Methods and supporting files

  • Ling result table

    Exact revision, file hash and size, repetitions, standard deviation, thermal limits, and selected row.

    ling-mini-iq4-xs-summary.csv
  • Ling method

    Artifact identity, true-CPU workload, and the disclosed thermal repeat.

    MATCHED_RETEST_PROTOCOL.md

Recorded setup

Threads
4
Prompt
128 tokens
Output
96 tokens
Measured runs
5
Generation stddev
0.009518
Thermal ceiling
90 °C
Source revision
8be84a0f4727

Artifact SHA-256a72d86d4cb4fedd940e34c08d008bb5cda42db80ce5c6bc5f9494e854a3d742d

Qwen3.5 0.8B
Q8_0
Ollama 0.32.1
CPU · Depth 1, MTP off
11.34 tok/sn/a74 °CPublished resultMTP depth sweep
Open result details

About this model

This is Qwen3.5 0.8B, a different family and size from Qwen3 0.6B. I tested normal Ollama generation and paired MTP settings on the X1S. MTP uses a draft path to propose tokens; the off/on rows show what that extra work cost on the N5095.

Family
Qwen3.5
Recorded size
0.8B

It is the speed-first CPU option from this result set and shows that active MTP still carried too much overhead on the four-core N5095.

What ran

Q8_0 ran through Ollama 0.32.1 using CPU in Depth 1, MTP off mode on Youyeetoo X1S.

Paired MTP-off baseline for draft depth 1.

Each on/off pair belongs to its own requested draft depth. Do not compare the baseline from one pair as if it were the same request block as another.

Methods and supporting files

  • Complete MTP table

    All 24 off/on rows across three models and four draft depths.

    mtp-depth-summary.csv
  • MTP result notes

    Draft-path proof, paired-output checks, temperature handling, and interpretation.

    MTP_RESULTS.md
  • Thermal guard events

    The two Gemma configurations that first stopped at the normal 85 °C guard.

    mtp-guard-events.csv

Recorded setup

Threads
4
Output
96 tokens
Batch
512 / 512 microbatch
Measured runs
1
Thermal ceiling
85 °C
Qwen3.5 0.8B
Q8_0
Ollama 0.32.1
CPU + draft MTP · Depth 1, MTP on
6.043 tok/sn/a75 °CPublished resultMTP depth sweep
Open result details

About this model

This is Qwen3.5 0.8B, a different family and size from Qwen3 0.6B. I tested normal Ollama generation and paired MTP settings on the X1S. MTP uses a draft path to propose tokens; the off/on rows show what that extra work cost on the N5095.

Family
Qwen3.5
Recorded size
0.8B

It is the speed-first CPU option from this result set and shows that active MTP still carried too much overhead on the four-core N5095.

What ran

Q8_0 ran through Ollama 0.32.1 using CPU + draft MTP in Depth 1, MTP on mode on Youyeetoo X1S.

MTP was active and ran 46.73% slower than its paired baseline.

Each on/off pair belongs to its own requested draft depth. Do not compare the baseline from one pair as if it were the same request block as another.

Methods and supporting files

  • Complete MTP table

    All 24 off/on rows across three models and four draft depths.

    mtp-depth-summary.csv
  • MTP result notes

    Draft-path proof, paired-output checks, temperature handling, and interpretation.

    MTP_RESULTS.md
  • Thermal guard events

    The two Gemma configurations that first stopped at the normal 85 °C guard.

    mtp-guard-events.csv

Recorded setup

Threads
4
Output
96 tokens
Batch
512 / 512 microbatch
Measured runs
1
Thermal ceiling
85 °C
Qwen3.5 0.8B
Q8_0
Ollama 0.32.1
CPU · Depth 2, MTP off
11.49 tok/sn/a77 °CPublished resultMTP depth sweep
Open result details

About this model

This is Qwen3.5 0.8B, a different family and size from Qwen3 0.6B. I tested normal Ollama generation and paired MTP settings on the X1S. MTP uses a draft path to propose tokens; the off/on rows show what that extra work cost on the N5095.

Family
Qwen3.5
Recorded size
0.8B

It is the speed-first CPU option from this result set and shows that active MTP still carried too much overhead on the four-core N5095.

What ran

Q8_0 ran through Ollama 0.32.1 using CPU in Depth 2, MTP off mode on Youyeetoo X1S.

Paired MTP-off baseline for draft depth 2.

Each on/off pair belongs to its own requested draft depth. Do not compare the baseline from one pair as if it were the same request block as another.

Methods and supporting files

  • Complete MTP table

    All 24 off/on rows across three models and four draft depths.

    mtp-depth-summary.csv
  • MTP result notes

    Draft-path proof, paired-output checks, temperature handling, and interpretation.

    MTP_RESULTS.md
  • Thermal guard events

    The two Gemma configurations that first stopped at the normal 85 °C guard.

    mtp-guard-events.csv

Recorded setup

Threads
4
Output
96 tokens
Batch
512 / 512 microbatch
Measured runs
1
Thermal ceiling
85 °C
Qwen3.5 0.8B
Q8_0
Ollama 0.32.1
CPU + draft MTP · Depth 2, MTP on
4.019 tok/sn/a79 °CPublished resultMTP depth sweep
Open result details

About this model

This is Qwen3.5 0.8B, a different family and size from Qwen3 0.6B. I tested normal Ollama generation and paired MTP settings on the X1S. MTP uses a draft path to propose tokens; the off/on rows show what that extra work cost on the N5095.

Family
Qwen3.5
Recorded size
0.8B

It is the speed-first CPU option from this result set and shows that active MTP still carried too much overhead on the four-core N5095.

What ran

Q8_0 ran through Ollama 0.32.1 using CPU + draft MTP in Depth 2, MTP on mode on Youyeetoo X1S.

MTP was active and ran 65.03% slower than its paired baseline.

Each on/off pair belongs to its own requested draft depth. Do not compare the baseline from one pair as if it were the same request block as another.

Methods and supporting files

  • Complete MTP table

    All 24 off/on rows across three models and four draft depths.

    mtp-depth-summary.csv
  • MTP result notes

    Draft-path proof, paired-output checks, temperature handling, and interpretation.

    MTP_RESULTS.md
  • Thermal guard events

    The two Gemma configurations that first stopped at the normal 85 °C guard.

    mtp-guard-events.csv

Recorded setup

Threads
4
Output
96 tokens
Batch
512 / 512 microbatch
Measured runs
1
Thermal ceiling
85 °C
Qwen3.5 0.8B
Q8_0
Ollama 0.32.1
CPU · Depth 3, MTP off
11.21 tok/sn/a76 °CPublished resultMTP depth sweep
Open result details

About this model

This is Qwen3.5 0.8B, a different family and size from Qwen3 0.6B. I tested normal Ollama generation and paired MTP settings on the X1S. MTP uses a draft path to propose tokens; the off/on rows show what that extra work cost on the N5095.

Family
Qwen3.5
Recorded size
0.8B

It is the speed-first CPU option from this result set and shows that active MTP still carried too much overhead on the four-core N5095.

What ran

Q8_0 ran through Ollama 0.32.1 using CPU in Depth 3, MTP off mode on Youyeetoo X1S.

Paired MTP-off baseline for draft depth 3.

Each on/off pair belongs to its own requested draft depth. Do not compare the baseline from one pair as if it were the same request block as another.

Methods and supporting files

  • Complete MTP table

    All 24 off/on rows across three models and four draft depths.

    mtp-depth-summary.csv
  • MTP result notes

    Draft-path proof, paired-output checks, temperature handling, and interpretation.

    MTP_RESULTS.md
  • Thermal guard events

    The two Gemma configurations that first stopped at the normal 85 °C guard.

    mtp-guard-events.csv

Recorded setup

Threads
4
Output
96 tokens
Batch
512 / 512 microbatch
Measured runs
1
Thermal ceiling
85 °C
Qwen3.5 0.8B
Q8_0
Ollama 0.32.1
CPU + draft MTP · Depth 3, MTP on
3.133 tok/sn/a77 °CPublished resultMTP depth sweep
Open result details

About this model

This is Qwen3.5 0.8B, a different family and size from Qwen3 0.6B. I tested normal Ollama generation and paired MTP settings on the X1S. MTP uses a draft path to propose tokens; the off/on rows show what that extra work cost on the N5095.

Family
Qwen3.5
Recorded size
0.8B

It is the speed-first CPU option from this result set and shows that active MTP still carried too much overhead on the four-core N5095.

What ran

Q8_0 ran through Ollama 0.32.1 using CPU + draft MTP in Depth 3, MTP on mode on Youyeetoo X1S.

MTP was active and ran 72.06% slower than its paired baseline.

Each on/off pair belongs to its own requested draft depth. Do not compare the baseline from one pair as if it were the same request block as another.

Methods and supporting files

  • Complete MTP table

    All 24 off/on rows across three models and four draft depths.

    mtp-depth-summary.csv
  • MTP result notes

    Draft-path proof, paired-output checks, temperature handling, and interpretation.

    MTP_RESULTS.md
  • Thermal guard events

    The two Gemma configurations that first stopped at the normal 85 °C guard.

    mtp-guard-events.csv

Recorded setup

Threads
4
Output
96 tokens
Batch
512 / 512 microbatch
Measured runs
1
Thermal ceiling
85 °C
Qwen3.5 0.8B
Q8_0
Ollama 0.32.1
CPU · Depth 4, MTP off
11.16 tok/sn/a78 °CPublished resultMTP depth sweep
Open result details

About this model

This is Qwen3.5 0.8B, a different family and size from Qwen3 0.6B. I tested normal Ollama generation and paired MTP settings on the X1S. MTP uses a draft path to propose tokens; the off/on rows show what that extra work cost on the N5095.

Family
Qwen3.5
Recorded size
0.8B

It is the speed-first CPU option from this result set and shows that active MTP still carried too much overhead on the four-core N5095.

What ran

Q8_0 ran through Ollama 0.32.1 using CPU in Depth 4, MTP off mode on Youyeetoo X1S.

Paired MTP-off baseline for draft depth 4.

Each on/off pair belongs to its own requested draft depth. Do not compare the baseline from one pair as if it were the same request block as another.

Methods and supporting files

  • Complete MTP table

    All 24 off/on rows across three models and four draft depths.

    mtp-depth-summary.csv
  • MTP result notes

    Draft-path proof, paired-output checks, temperature handling, and interpretation.

    MTP_RESULTS.md
  • Thermal guard events

    The two Gemma configurations that first stopped at the normal 85 °C guard.

    mtp-guard-events.csv

Recorded setup

Threads
4
Output
96 tokens
Batch
512 / 512 microbatch
Measured runs
5
Thermal ceiling
85 °C
Qwen3.5 0.8B
Q8_0
Ollama 0.32.1
CPU + draft MTP · Depth 4, MTP on
2.624 tok/sn/a79 °CPublished resultMTP depth sweep
Open result details

About this model

This is Qwen3.5 0.8B, a different family and size from Qwen3 0.6B. I tested normal Ollama generation and paired MTP settings on the X1S. MTP uses a draft path to propose tokens; the off/on rows show what that extra work cost on the N5095.

Family
Qwen3.5
Recorded size
0.8B

It is the speed-first CPU option from this result set and shows that active MTP still carried too much overhead on the four-core N5095.

What ran

Q8_0 ran through Ollama 0.32.1 using CPU + draft MTP in Depth 4, MTP on mode on Youyeetoo X1S.

MTP was active and ran 76.48% slower than its paired baseline.

Each on/off pair belongs to its own requested draft depth. Do not compare the baseline from one pair as if it were the same request block as another.

Methods and supporting files

  • Complete MTP table

    All 24 off/on rows across three models and four draft depths.

    mtp-depth-summary.csv
  • MTP result notes

    Draft-path proof, paired-output checks, temperature handling, and interpretation.

    MTP_RESULTS.md
  • Thermal guard events

    The two Gemma configurations that first stopped at the normal 85 °C guard.

    mtp-guard-events.csv

Recorded setup

Threads
4
Output
96 tokens
Batch
512 / 512 microbatch
Measured runs
5
Thermal ceiling
85 °C
Qwen3.5 2B
Q8_0
Ollama 0.32.1
CPU · Depth 1, MTP off
4.891 tok/sn/a78 °CPublished resultMTP depth sweep
Open result details

About this model

Qwen3.5 2B sits between the 0.8B and 9B entries in the X1S collection. It has a normal Ollama result and a separate MTP depth sweep, which lets you inspect how draft settings behaved at another model size.

Family
Qwen3.5
Recorded size
2B

It sits between the 0.8B speed result and the slower larger models, making it useful for checking whether MTP behavior changed with model size.

What ran

Q8_0 ran through Ollama 0.32.1 using CPU in Depth 1, MTP off mode on Youyeetoo X1S.

Paired MTP-off baseline for draft depth 1.

Each on/off pair belongs to its own requested draft depth. Do not compare the baseline from one pair as if it were the same request block as another.

Methods and supporting files

  • Complete MTP table

    All 24 off/on rows across three models and four draft depths.

    mtp-depth-summary.csv
  • MTP result notes

    Draft-path proof, paired-output checks, temperature handling, and interpretation.

    MTP_RESULTS.md
  • Thermal guard events

    The two Gemma configurations that first stopped at the normal 85 °C guard.

    mtp-guard-events.csv

Recorded setup

Threads
4
Output
96 tokens
Batch
512 / 512 microbatch
Measured runs
1
Thermal ceiling
85 °C
Qwen3.5 2B
Q8_0
Ollama 0.32.1
CPU + draft MTP · Depth 1, MTP on
3.778 tok/sn/a77 °CPublished resultMTP depth sweep
Open result details

About this model

Qwen3.5 2B sits between the 0.8B and 9B entries in the X1S collection. It has a normal Ollama result and a separate MTP depth sweep, which lets you inspect how draft settings behaved at another model size.

Family
Qwen3.5
Recorded size
2B

It sits between the 0.8B speed result and the slower larger models, making it useful for checking whether MTP behavior changed with model size.

What ran

Q8_0 ran through Ollama 0.32.1 using CPU + draft MTP in Depth 1, MTP on mode on Youyeetoo X1S.

MTP was active and ran 22.76% slower than its paired baseline.

Each on/off pair belongs to its own requested draft depth. Do not compare the baseline from one pair as if it were the same request block as another.

Methods and supporting files

  • Complete MTP table

    All 24 off/on rows across three models and four draft depths.

    mtp-depth-summary.csv
  • MTP result notes

    Draft-path proof, paired-output checks, temperature handling, and interpretation.

    MTP_RESULTS.md
  • Thermal guard events

    The two Gemma configurations that first stopped at the normal 85 °C guard.

    mtp-guard-events.csv

Recorded setup

Threads
4
Output
96 tokens
Batch
512 / 512 microbatch
Measured runs
1
Thermal ceiling
85 °C
Qwen3.5 2B
Q8_0
Ollama 0.32.1
CPU · Depth 2, MTP off
5.154 tok/sn/a79 °CPublished resultMTP depth sweep
Open result details

About this model

Qwen3.5 2B sits between the 0.8B and 9B entries in the X1S collection. It has a normal Ollama result and a separate MTP depth sweep, which lets you inspect how draft settings behaved at another model size.

Family
Qwen3.5
Recorded size
2B

It sits between the 0.8B speed result and the slower larger models, making it useful for checking whether MTP behavior changed with model size.

What ran

Q8_0 ran through Ollama 0.32.1 using CPU in Depth 2, MTP off mode on Youyeetoo X1S.

Paired MTP-off baseline for draft depth 2.

Each on/off pair belongs to its own requested draft depth. Do not compare the baseline from one pair as if it were the same request block as another.

Methods and supporting files

  • Complete MTP table

    All 24 off/on rows across three models and four draft depths.

    mtp-depth-summary.csv
  • MTP result notes

    Draft-path proof, paired-output checks, temperature handling, and interpretation.

    MTP_RESULTS.md
  • Thermal guard events

    The two Gemma configurations that first stopped at the normal 85 °C guard.

    mtp-guard-events.csv

Recorded setup

Threads
4
Output
96 tokens
Batch
512 / 512 microbatch
Measured runs
1
Thermal ceiling
85 °C
Qwen3.5 2B
Q8_0
Ollama 0.32.1
CPU + draft MTP · Depth 2, MTP on
2.853 tok/sn/a79 °CPublished resultMTP depth sweep
Open result details

About this model

Qwen3.5 2B sits between the 0.8B and 9B entries in the X1S collection. It has a normal Ollama result and a separate MTP depth sweep, which lets you inspect how draft settings behaved at another model size.

Family
Qwen3.5
Recorded size
2B

It sits between the 0.8B speed result and the slower larger models, making it useful for checking whether MTP behavior changed with model size.

What ran

Q8_0 ran through Ollama 0.32.1 using CPU + draft MTP in Depth 2, MTP on mode on Youyeetoo X1S.

MTP was active and ran 44.65% slower than its paired baseline.

Each on/off pair belongs to its own requested draft depth. Do not compare the baseline from one pair as if it were the same request block as another.

Methods and supporting files

  • Complete MTP table

    All 24 off/on rows across three models and four draft depths.

    mtp-depth-summary.csv
  • MTP result notes

    Draft-path proof, paired-output checks, temperature handling, and interpretation.

    MTP_RESULTS.md
  • Thermal guard events

    The two Gemma configurations that first stopped at the normal 85 °C guard.

    mtp-guard-events.csv

Recorded setup

Threads
4
Output
96 tokens
Batch
512 / 512 microbatch
Measured runs
1
Thermal ceiling
85 °C
Qwen3.5 2B
Q8_0
Ollama 0.32.1
CPU · Depth 3, MTP off
4.853 tok/sn/a80 °CPublished resultMTP depth sweep
Open result details

About this model

Qwen3.5 2B sits between the 0.8B and 9B entries in the X1S collection. It has a normal Ollama result and a separate MTP depth sweep, which lets you inspect how draft settings behaved at another model size.

Family
Qwen3.5
Recorded size
2B

It sits between the 0.8B speed result and the slower larger models, making it useful for checking whether MTP behavior changed with model size.

What ran

Q8_0 ran through Ollama 0.32.1 using CPU in Depth 3, MTP off mode on Youyeetoo X1S.

Paired MTP-off baseline for draft depth 3.

Each on/off pair belongs to its own requested draft depth. Do not compare the baseline from one pair as if it were the same request block as another.

Methods and supporting files

  • Complete MTP table

    All 24 off/on rows across three models and four draft depths.

    mtp-depth-summary.csv
  • MTP result notes

    Draft-path proof, paired-output checks, temperature handling, and interpretation.

    MTP_RESULTS.md
  • Thermal guard events

    The two Gemma configurations that first stopped at the normal 85 °C guard.

    mtp-guard-events.csv

Recorded setup

Threads
4
Output
96 tokens
Batch
512 / 512 microbatch
Measured runs
1
Thermal ceiling
85 °C
Qwen3.5 2B
Q8_0
Ollama 0.32.1
CPU + draft MTP · Depth 3, MTP on
2.599 tok/sn/a80 °CPublished resultMTP depth sweep
Open result details

About this model

Qwen3.5 2B sits between the 0.8B and 9B entries in the X1S collection. It has a normal Ollama result and a separate MTP depth sweep, which lets you inspect how draft settings behaved at another model size.

Family
Qwen3.5
Recorded size
2B

It sits between the 0.8B speed result and the slower larger models, making it useful for checking whether MTP behavior changed with model size.

What ran

Q8_0 ran through Ollama 0.32.1 using CPU + draft MTP in Depth 3, MTP on mode on Youyeetoo X1S.

MTP was active and ran 46.45% slower than its paired baseline.

Each on/off pair belongs to its own requested draft depth. Do not compare the baseline from one pair as if it were the same request block as another.

Methods and supporting files

  • Complete MTP table

    All 24 off/on rows across three models and four draft depths.

    mtp-depth-summary.csv
  • MTP result notes

    Draft-path proof, paired-output checks, temperature handling, and interpretation.

    MTP_RESULTS.md
  • Thermal guard events

    The two Gemma configurations that first stopped at the normal 85 °C guard.

    mtp-guard-events.csv

Recorded setup

Threads
4
Output
96 tokens
Batch
512 / 512 microbatch
Measured runs
1
Thermal ceiling
85 °C
Qwen3.5 2B
Q8_0
Ollama 0.32.1
CPU · Depth 4, MTP off
5.121 tok/sn/a80 °CPublished resultMTP depth sweep
Open result details

About this model

Qwen3.5 2B sits between the 0.8B and 9B entries in the X1S collection. It has a normal Ollama result and a separate MTP depth sweep, which lets you inspect how draft settings behaved at another model size.

Family
Qwen3.5
Recorded size
2B

It sits between the 0.8B speed result and the slower larger models, making it useful for checking whether MTP behavior changed with model size.

What ran

Q8_0 ran through Ollama 0.32.1 using CPU in Depth 4, MTP off mode on Youyeetoo X1S.

Paired MTP-off baseline for draft depth 4.

Each on/off pair belongs to its own requested draft depth. Do not compare the baseline from one pair as if it were the same request block as another.

Methods and supporting files

  • Complete MTP table

    All 24 off/on rows across three models and four draft depths.

    mtp-depth-summary.csv
  • MTP result notes

    Draft-path proof, paired-output checks, temperature handling, and interpretation.

    MTP_RESULTS.md
  • Thermal guard events

    The two Gemma configurations that first stopped at the normal 85 °C guard.

    mtp-guard-events.csv

Recorded setup

Threads
4
Output
96 tokens
Batch
512 / 512 microbatch
Measured runs
5
Thermal ceiling
85 °C
Qwen3.5 2B
Q8_0
Ollama 0.32.1
CPU + draft MTP · Depth 4, MTP on
1.522 tok/sn/a79 °CPublished resultMTP depth sweep
Open result details

About this model

Qwen3.5 2B sits between the 0.8B and 9B entries in the X1S collection. It has a normal Ollama result and a separate MTP depth sweep, which lets you inspect how draft settings behaved at another model size.

Family
Qwen3.5
Recorded size
2B

It sits between the 0.8B speed result and the slower larger models, making it useful for checking whether MTP behavior changed with model size.

What ran

Q8_0 ran through Ollama 0.32.1 using CPU + draft MTP in Depth 4, MTP on mode on Youyeetoo X1S.

MTP was active and ran 70.28% slower than its paired baseline.

Each on/off pair belongs to its own requested draft depth. Do not compare the baseline from one pair as if it were the same request block as another.

Methods and supporting files

  • Complete MTP table

    All 24 off/on rows across three models and four draft depths.

    mtp-depth-summary.csv
  • MTP result notes

    Draft-path proof, paired-output checks, temperature handling, and interpretation.

    MTP_RESULTS.md
  • Thermal guard events

    The two Gemma configurations that first stopped at the normal 85 °C guard.

    mtp-guard-events.csv

Recorded setup

Threads
4
Output
96 tokens
Batch
512 / 512 microbatch
Measured runs
5
Thermal ceiling
85 °C
Gemma 4 E2B
Q4_K_M
Ollama 0.32.1
CPU · Depth 1, MTP off
3.269 tok/sn/a80 °CPublished resultMTP depth sweep
Open result details

About this model

Gemma 4 E2B used a separate assistant model for the X1S MTP tests. I kept the draft-path proof and off/on pairs because loading the main model alone would not establish that speculative decoding was active.

Family
Gemma 4
Recorded size
E2B

It tested the MTP path that required an external assistant instead of assuming the presence of model tensors meant speculative decoding was active.

What ran

Q4_K_M ran through Ollama 0.32.1 using CPU in Depth 1, MTP off mode on Youyeetoo X1S.

Paired MTP-off baseline for draft depth 1.

Each on/off pair belongs to its own requested draft depth. Do not compare the baseline from one pair as if it were the same request block as another.

Methods and supporting files

  • Complete MTP table

    All 24 off/on rows across three models and four draft depths.

    mtp-depth-summary.csv
  • MTP result notes

    Draft-path proof, paired-output checks, temperature handling, and interpretation.

    MTP_RESULTS.md
  • Thermal guard events

    The two Gemma configurations that first stopped at the normal 85 °C guard.

    mtp-guard-events.csv

Recorded setup

Threads
4
Output
96 tokens
Batch
512 / 512 microbatch
Measured runs
1
Thermal ceiling
85 °C
Gemma 4 E2B
Q4_K_M
Ollama 0.32.1
CPU + draft MTP · Depth 1, MTP on
2.266 tok/sn/a84 °CPublished resultMTP depth sweep
Open result details

About this model

Gemma 4 E2B used a separate assistant model for the X1S MTP tests. I kept the draft-path proof and off/on pairs because loading the main model alone would not establish that speculative decoding was active.

Family
Gemma 4
Recorded size
E2B

It tested the MTP path that required an external assistant instead of assuming the presence of model tensors meant speculative decoding was active.

What ran

Q4_K_M ran through Ollama 0.32.1 using CPU + draft MTP in Depth 1, MTP on mode on Youyeetoo X1S.

MTP was active and ran 30.68% slower than its paired baseline.

Each on/off pair belongs to its own requested draft depth. Do not compare the baseline from one pair as if it were the same request block as another.

Methods and supporting files

  • Complete MTP table

    All 24 off/on rows across three models and four draft depths.

    mtp-depth-summary.csv
  • MTP result notes

    Draft-path proof, paired-output checks, temperature handling, and interpretation.

    MTP_RESULTS.md
  • Thermal guard events

    The two Gemma configurations that first stopped at the normal 85 °C guard.

    mtp-guard-events.csv

Recorded setup

Threads
4
Output
96 tokens
Batch
512 / 512 microbatch
Measured runs
1
Thermal ceiling
85 °C
Gemma 4 E2B
Q4_K_M
Ollama 0.32.1
CPU · Depth 2, MTP off
3.359 tok/sn/a80 °CPublished resultMTP depth sweep
Open result details

About this model

Gemma 4 E2B used a separate assistant model for the X1S MTP tests. I kept the draft-path proof and off/on pairs because loading the main model alone would not establish that speculative decoding was active.

Family
Gemma 4
Recorded size
E2B

It tested the MTP path that required an external assistant instead of assuming the presence of model tensors meant speculative decoding was active.

What ran

Q4_K_M ran through Ollama 0.32.1 using CPU in Depth 2, MTP off mode on Youyeetoo X1S.

Paired MTP-off baseline for draft depth 2. This pair includes a 90 °C rerun after the first attempt stopped at the normal 85 °C guard.

Each on/off pair belongs to its own requested draft depth. Do not compare the baseline from one pair as if it were the same request block as another.

Methods and supporting files

  • Complete MTP table

    All 24 off/on rows across three models and four draft depths.

    mtp-depth-summary.csv
  • MTP result notes

    Draft-path proof, paired-output checks, temperature handling, and interpretation.

    MTP_RESULTS.md
  • Thermal guard events

    The two Gemma configurations that first stopped at the normal 85 °C guard.

    mtp-guard-events.csv

Recorded setup

Threads
4
Output
96 tokens
Batch
512 / 512 microbatch
Measured runs
1
Thermal ceiling
90 °C
Gemma 4 E2B
Q4_K_M
Ollama 0.32.1
CPU + draft MTP · Depth 2, MTP on
1.96 tok/sn/a84 °CPublished resultMTP depth sweep
Open result details

About this model

Gemma 4 E2B used a separate assistant model for the X1S MTP tests. I kept the draft-path proof and off/on pairs because loading the main model alone would not establish that speculative decoding was active.

Family
Gemma 4
Recorded size
E2B

It tested the MTP path that required an external assistant instead of assuming the presence of model tensors meant speculative decoding was active.

What ran

Q4_K_M ran through Ollama 0.32.1 using CPU + draft MTP in Depth 2, MTP on mode on Youyeetoo X1S.

MTP was active and ran 41.63% slower than its paired baseline. This pair includes a 90 °C rerun after the first attempt stopped at the normal 85 °C guard.

Each on/off pair belongs to its own requested draft depth. Do not compare the baseline from one pair as if it were the same request block as another.

Methods and supporting files

  • Complete MTP table

    All 24 off/on rows across three models and four draft depths.

    mtp-depth-summary.csv
  • MTP result notes

    Draft-path proof, paired-output checks, temperature handling, and interpretation.

    MTP_RESULTS.md
  • Thermal guard events

    The two Gemma configurations that first stopped at the normal 85 °C guard.

    mtp-guard-events.csv

Recorded setup

Threads
4
Output
96 tokens
Batch
512 / 512 microbatch
Measured runs
1
Thermal ceiling
90 °C
Gemma 4 E2B
Q4_K_M
Ollama 0.32.1
CPU · Depth 3, MTP off
3.352 tok/sn/a82 °CPublished resultMTP depth sweep
Open result details

About this model

Gemma 4 E2B used a separate assistant model for the X1S MTP tests. I kept the draft-path proof and off/on pairs because loading the main model alone would not establish that speculative decoding was active.

Family
Gemma 4
Recorded size
E2B

It tested the MTP path that required an external assistant instead of assuming the presence of model tensors meant speculative decoding was active.

What ran

Q4_K_M ran through Ollama 0.32.1 using CPU in Depth 3, MTP off mode on Youyeetoo X1S.

Paired MTP-off baseline for draft depth 3. This pair includes a 90 °C rerun after the first attempt stopped at the normal 85 °C guard.

Each on/off pair belongs to its own requested draft depth. Do not compare the baseline from one pair as if it were the same request block as another.

Methods and supporting files

  • Complete MTP table

    All 24 off/on rows across three models and four draft depths.

    mtp-depth-summary.csv
  • MTP result notes

    Draft-path proof, paired-output checks, temperature handling, and interpretation.

    MTP_RESULTS.md
  • Thermal guard events

    The two Gemma configurations that first stopped at the normal 85 °C guard.

    mtp-guard-events.csv

Recorded setup

Threads
4
Output
96 tokens
Batch
512 / 512 microbatch
Measured runs
1
Thermal ceiling
90 °C
Gemma 4 E2B
Q4_K_M
Ollama 0.32.1
CPU + draft MTP · Depth 3, MTP on
1.474 tok/sn/a86 °CPublished resultMTP depth sweep
Open result details

About this model

Gemma 4 E2B used a separate assistant model for the X1S MTP tests. I kept the draft-path proof and off/on pairs because loading the main model alone would not establish that speculative decoding was active.

Family
Gemma 4
Recorded size
E2B

It tested the MTP path that required an external assistant instead of assuming the presence of model tensors meant speculative decoding was active.

What ran

Q4_K_M ran through Ollama 0.32.1 using CPU + draft MTP in Depth 3, MTP on mode on Youyeetoo X1S.

MTP was active and ran 56.03% slower than its paired baseline. This pair includes a 90 °C rerun after the first attempt stopped at the normal 85 °C guard.

Each on/off pair belongs to its own requested draft depth. Do not compare the baseline from one pair as if it were the same request block as another.

Methods and supporting files

  • Complete MTP table

    All 24 off/on rows across three models and four draft depths.

    mtp-depth-summary.csv
  • MTP result notes

    Draft-path proof, paired-output checks, temperature handling, and interpretation.

    MTP_RESULTS.md
  • Thermal guard events

    The two Gemma configurations that first stopped at the normal 85 °C guard.

    mtp-guard-events.csv

Recorded setup

Threads
4
Output
96 tokens
Batch
512 / 512 microbatch
Measured runs
1
Thermal ceiling
90 °C
Gemma 4 E2B
Q4_K_M
Ollama 0.32.1
CPU · Depth 4, MTP off
3.397 tok/sn/a81 °CPublished resultMTP depth sweep
Open result details

About this model

Gemma 4 E2B used a separate assistant model for the X1S MTP tests. I kept the draft-path proof and off/on pairs because loading the main model alone would not establish that speculative decoding was active.

Family
Gemma 4
Recorded size
E2B

It tested the MTP path that required an external assistant instead of assuming the presence of model tensors meant speculative decoding was active.

What ran

Q4_K_M ran through Ollama 0.32.1 using CPU in Depth 4, MTP off mode on Youyeetoo X1S.

Paired MTP-off baseline for draft depth 4.

Each on/off pair belongs to its own requested draft depth. Do not compare the baseline from one pair as if it were the same request block as another.

Methods and supporting files

  • Complete MTP table

    All 24 off/on rows across three models and four draft depths.

    mtp-depth-summary.csv
  • MTP result notes

    Draft-path proof, paired-output checks, temperature handling, and interpretation.

    MTP_RESULTS.md
  • Thermal guard events

    The two Gemma configurations that first stopped at the normal 85 °C guard.

    mtp-guard-events.csv

Recorded setup

Threads
4
Output
96 tokens
Batch
512 / 512 microbatch
Measured runs
5
Thermal ceiling
85 °C
Gemma 4 E2B
Q4_K_M
Ollama 0.32.1
CPU + draft MTP · Depth 4, MTP on
1.333 tok/sn/a84 °CPublished resultMTP depth sweep
Open result details

About this model

Gemma 4 E2B used a separate assistant model for the X1S MTP tests. I kept the draft-path proof and off/on pairs because loading the main model alone would not establish that speculative decoding was active.

Family
Gemma 4
Recorded size
E2B

It tested the MTP path that required an external assistant instead of assuming the presence of model tensors meant speculative decoding was active.

What ran

Q4_K_M ran through Ollama 0.32.1 using CPU + draft MTP in Depth 4, MTP on mode on Youyeetoo X1S.

MTP was active and ran 60.75% slower than its paired baseline.

Each on/off pair belongs to its own requested draft depth. Do not compare the baseline from one pair as if it were the same request block as another.

Methods and supporting files

  • Complete MTP table

    All 24 off/on rows across three models and four draft depths.

    mtp-depth-summary.csv
  • MTP result notes

    Draft-path proof, paired-output checks, temperature handling, and interpretation.

    MTP_RESULTS.md
  • Thermal guard events

    The two Gemma configurations that first stopped at the normal 85 °C guard.

    mtp-guard-events.csv

Recorded setup

Threads
4
Output
96 tokens
Batch
512 / 512 microbatch
Measured runs
5
Thermal ceiling
85 °C
Qwen3.5 0.8B
Q8_0
Ollama 0.32.1
CPU · Two-run warm average
10.44 tok/sn/a70 °CPublished resultAdditional models
Open result details

About this model

This is Qwen3.5 0.8B, a different family and size from Qwen3 0.6B. I tested normal Ollama generation and paired MTP settings on the X1S. MTP uses a draft path to propose tokens; the off/on rows show what that extra work cost on the N5095.

Family
Qwen3.5
Recorded size
0.8B

It is the speed-first CPU option from this result set and shows that active MTP still carried too much overhead on the four-core N5095.

What ran

Q8_0 ran through Ollama 0.32.1 using CPU in Two-run warm average mode on Youyeetoo X1S.

The fastest normal text-generation result in the X1S work. Throughput does not establish answer quality.

The rows use different repetition counts and artifact states. They are useful operating points, not one controlled model-quality contest.

Methods and supporting files

  • Additional model results

    Normal Ollama rows, Ling, MTP, compatibility outcomes, and the untested boundary.

    FOLLOWUP_RESULTS.md
  • Model status table

    Exact artifacts where retained, completed results, and models without trustworthy measurements.

    CANDIDATE_MODEL_TABLE.md

Recorded setup

Context
4,096 tokens
Measured runs
2
Thermal ceiling
85 °C
Qwen3.5 2B
Q8_0
Ollama 0.32.1
CPU · Two-run warm average
4.89 tok/sn/a75 °CPublished resultAdditional models
Open result details

About this model

Qwen3.5 2B sits between the 0.8B and 9B entries in the X1S collection. It has a normal Ollama result and a separate MTP depth sweep, which lets you inspect how draft settings behaved at another model size.

Family
Qwen3.5
Recorded size
2B

It sits between the 0.8B speed result and the slower larger models, making it useful for checking whether MTP behavior changed with model size.

What ran

Q8_0 ran through Ollama 0.32.1 using CPU in Two-run warm average mode on Youyeetoo X1S.

A clean middle-tier CPU result from the normal non-MTP Ollama path.

The rows use different repetition counts and artifact states. They are useful operating points, not one controlled model-quality contest.

Methods and supporting files

  • Additional model results

    Normal Ollama rows, Ling, MTP, compatibility outcomes, and the untested boundary.

    FOLLOWUP_RESULTS.md
  • Model status table

    Exact artifacts where retained, completed results, and models without trustworthy measurements.

    CANDIDATE_MODEL_TABLE.md

Recorded setup

Context
4,096 tokens
Measured runs
2
Thermal ceiling
85 °C
Qwen3.5 9B
Q4_K_M
Ollama 0.32.1
CPU · Five-prompt average
1.11 tok/sn/a82 °CPublished resultAdditional models
Open result details

About this model

Qwen3.5 9B has records from two different projects: fitting a larger model on the X1S and producing structured Home SOC reports on the Minisforum. Generation speed and completed report checks measure different things. Each test keeps its own workload, runtime and outcome.

Family
Qwen3.5
Recorded size
9B

This was a fit-and-completion test for a much larger model on the X1S, not a claim that 1.110 tok/s is comfortable interactive speed.

What ran

Q4_K_M ran through Ollama 0.32.1 using CPU in Five-prompt average mode on Youyeetoo X1S.

The 9B artifact fit in 16 GB and completed five prompts, but generation requires patience.

The rows use different repetition counts and artifact states. They are useful operating points, not one controlled model-quality contest.

Methods and supporting files

  • Additional model results

    Normal Ollama rows, Ling, MTP, compatibility outcomes, and the untested boundary.

    FOLLOWUP_RESULTS.md
  • Model status table

    Exact artifacts where retained, completed results, and models without trustworthy measurements.

    CANDIDATE_MODEL_TABLE.md

Recorded setup

Measured runs
5
Thermal ceiling
85 °C

Artifact SHA-256dec52a44569a2a25341c4e4d3fee25846eed4f6f0b936278e3a3c900bb99d37c

Gemma 4 E2B
Q4_K_M
Ollama 0.32.1
CPU · Two-run warm average
3.38 tok/sn/a77 °CPublished resultAdditional models
Open result details

About this model

Gemma 4 E2B used a separate assistant model for the X1S MTP tests. I kept the draft-path proof and off/on pairs because loading the main model alone would not establish that speculative decoding was active.

Family
Gemma 4
Recorded size
E2B

It tested the MTP path that required an external assistant instead of assuming the presence of model tensors meant speculative decoding was active.

What ran

Q4_K_M ran through Ollama 0.32.1 using CPU in Two-run warm average mode on Youyeetoo X1S.

The normal non-MTP Ollama result. The separate MTP sweep is recorded in its own test group.

The rows use different repetition counts and artifact states. They are useful operating points, not one controlled model-quality contest.

Methods and supporting files

  • Additional model results

    Normal Ollama rows, Ling, MTP, compatibility outcomes, and the untested boundary.

    FOLLOWUP_RESULTS.md
  • Model status table

    Exact artifacts where retained, completed results, and models without trustworthy measurements.

    CANDIDATE_MODEL_TABLE.md

Recorded setup

Context
4,096 tokens
Measured runs
2
Thermal ceiling
85 °C
Gemma 4 E4B
Q4_K_M
Ollama 0.32.1
CPU · Two-run warm average
1.78 tok/sn/a78 °CPublished resultAdditional models
Open result details

About this model

This Gemma 4 E4B entry records the original warm Ollama run on the X1S. It is a useful reference when browsing that test, with its original method and status kept on the result row.

Family
Gemma 4
Recorded size
E4B

The row is useful as a recorded X1S operating point, but it does not have enough separate material for an indexable model page yet.

What ran

Q4_K_M ran through Ollama 0.32.1 using CPU in Two-run warm average mode on Youyeetoo X1S.

A clean normal Ollama row retained as an operating point, not a quality ranking.

The rows use different repetition counts and artifact states. They are useful operating points, not one controlled model-quality contest.

Methods and supporting files

  • Additional model results

    Normal Ollama rows, Ling, MTP, compatibility outcomes, and the untested boundary.

    FOLLOWUP_RESULTS.md
  • Model status table

    Exact artifacts where retained, completed results, and models without trustworthy measurements.

    CANDIDATE_MODEL_TABLE.md

Recorded setup

Context
4,096 tokens
Measured runs
2
Thermal ceiling
85 °C
Granite 4 Tiny-H
Original Ollama tag
Ollama 0.32.1
CPU · Single original observation
5.43 tok/sn/a79 °CPartial resultAdditional models
Open result details

About this model

Granite 4 Tiny-H has one retained Ollama observation on the X1S. The result links back to that test rather than expanding a single measurement into a broader model comparison.

Family
Granite 4
Recorded size
Tiny-H

One observation is retained for completeness but is not promoted into a deeper standalone page.

What ran

Original Ollama tag ran through Ollama 0.32.1 using CPU in Single original observation mode on Youyeetoo X1S.

One retained observation, not a repeated average.

The rows use different repetition counts and artifact states. They are useful operating points, not one controlled model-quality contest.

Methods and supporting files

  • Additional model results

    Normal Ollama rows, Ling, MTP, compatibility outcomes, and the untested boundary.

    FOLLOWUP_RESULTS.md
  • Model status table

    Exact artifacts where retained, completed results, and models without trustworthy measurements.

    CANDIDATE_MODEL_TABLE.md

Recorded setup

Measured runs
1
Thermal ceiling
85 °C
LFM2.5
Mutable latest tag
Ollama 0.32.1
CPU · Single recorded tag state
4.95 tok/sn/a80 °CPartial resultAdditional models
Open result details

About this model

This entry keeps the LFM2.5 label from the original Ollama run. It used a mutable latest tag, so the row preserves the dated observation and the artifact limitation together.

Family
LFM
Recorded size
2.5

The tag was not content-pinned, so the row stays visible as a partial result without becoming its own search page.

What ran

Mutable latest tag ran through Ollama 0.32.1 using CPU in Single recorded tag state mode on Youyeetoo X1S.

The mutable latest tag was not content-pinned, so this remains a partial result.

The rows use different repetition counts and artifact states. They are useful operating points, not one controlled model-quality contest.

Methods and supporting files

  • Additional model results

    Normal Ollama rows, Ling, MTP, compatibility outcomes, and the untested boundary.

    FOLLOWUP_RESULTS.md
  • Model status table

    Exact artifacts where retained, completed results, and models without trustworthy measurements.

    CANDIDATE_MODEL_TABLE.md

Recorded setup

Measured runs
1
Thermal ceiling
85 °C
Gemma 3n E2B
gemma3n:e2b
Ollama 0.32.1
CPU · Single original observation
3.24 tok/sn/a80 °CPartial resultAdditional models
Open result details

About this model

Gemma 3n E2B is a separate entry from Gemma 4 E2B. Its X1S record comes from the original Ollama test, with that run linked directly below.

Family
Gemma 3n
Recorded size
E2B

The row is kept separate from Gemma 4 E2B and does not yet have enough unique material for its own page.

What ran

gemma3n:e2b ran through Ollama 0.32.1 using CPU in Single original observation mode on Youyeetoo X1S.

One retained observation. This is Gemma 3n E2B, not Gemma 4 E2B.

The rows use different repetition counts and artifact states. They are useful operating points, not one controlled model-quality contest.

Methods and supporting files

  • Additional model results

    Normal Ollama rows, Ling, MTP, compatibility outcomes, and the untested boundary.

    FOLLOWUP_RESULTS.md
  • Model status table

    Exact artifacts where retained, completed results, and models without trustworthy measurements.

    CANDIDATE_MODEL_TABLE.md

Recorded setup

Measured runs
1
Thermal ceiling
85 °C
BitCPM-CANN 1B
Official TQ2_0 GGUF
llama.cpp 9a286ac
CPU · True CPU, five repetitions
8.584 tok/s13.01 tok/s76 °CPublished resultRuntime compatibility
Open result details

About this model

BitCPM-CANN 1B is recorded here as the official TQ2_0 GGUF. I gave the same verified file to llama.cpp and Ollama, and they did not have the same loading outcome. The useful question here is runtime compatibility before it is generation speed.

Family
BitCPM
Recorded size
1B

This is a runtime-support result, not a speed contest. The same verified file produced inference in one runtime and a tensor-size overflow in the other.

What ran

Official TQ2_0 GGUF ran through llama.cpp 9a286ac using CPU in True CPU, five repetitions mode on Youyeetoo X1S.

Pinned llama.cpp accepted the verified file and completed the controlled true-CPU workload.

BitCPM is not a matched runtime speed contest because Ollama never loaded the model. The Gemma derivative is inspectable but does not repair the Vulkan device-loss path.

Methods and supporting files

  • Compatibility table

    Exact hashes, settings, repetitions, rates, standard deviation, and package peaks.

    compatibility-summary.csv
  • Compatibility notes

    What failed, what ran, and why the two cases are not one runtime benchmark.

    FOLLOWUP_RESULTS.md

Recorded setup

Threads
4
Prompt
128 tokens
Output
96 tokens
Batch
512 / 512 microbatch
Measured runs
5
Generation stddev
0.029317
Thermal ceiling
85 °C

Artifact SHA-2562394c15cbea2181b72bfb4215d8417d8d1f2f6214069da2d01fde32ce3b13fce

BitCPM-CANN 1B
Official TQ2_0 GGUF
Ollama 0.32.1
CPU · Model load
n/an/an/aFailed runRuntime compatibility
Open result details

About this model

BitCPM-CANN 1B is recorded here as the official TQ2_0 GGUF. I gave the same verified file to llama.cpp and Ollama, and they did not have the same loading outcome. The useful question here is runtime compatibility before it is generation speed.

Family
BitCPM
Recorded size
1B

This is a runtime-support result, not a speed contest. The same verified file produced inference in one runtime and a tensor-size overflow in the other.

What ran

Official TQ2_0 GGUF ran through Ollama 0.32.1 using CPU in Model load mode on Youyeetoo X1S.

Ollama rejected the same verified file with a tensor-size overflow before inference.

BitCPM is not a matched runtime speed contest because Ollama never loaded the model. The Gemma derivative is inspectable but does not repair the Vulkan device-loss path.

Methods and supporting files

  • Compatibility table

    Exact hashes, settings, repetitions, rates, standard deviation, and package peaks.

    compatibility-summary.csv
  • Compatibility notes

    What failed, what ran, and why the two cases are not one runtime benchmark.

    FOLLOWUP_RESULTS.md

Recorded setup

The full test page contains the shared controls and comparison boundary for this row.

Artifact SHA-2562394c15cbea2181b72bfb4215d8417d8d1f2f6214069da2d01fde32ce3b13fce

Gemma 3 4B
Separate text-only derivative
llama.cpp 9a286ac
CPU · True CPU, five repetitions
1.624 tok/s2.172 tok/s81 °CPublished resultRuntime compatibility
Open result details

About this model

The Gemma 3 entry includes a separate text-only derivative made from the original artifact. That distinction matters when reproducing the run: the derivative completed true CPU, while the later Vulkan attempt still hit the device-loss path. Keep the file identity with the result.

Family
Gemma 3
Recorded size
4B

It records two different compatibility boundaries: converting the older multimodal artifact for current llama.cpp and the separate Vulkan failure that conversion did not fix.

What ran

Separate text-only derivative ran through llama.cpp 9a286ac using CPU in True CPU, five repetitions mode on Youyeetoo X1S.

The derived copy completed true CPU. The original multimodal source artifact was not overwritten.

BitCPM is not a matched runtime speed contest because Ollama never loaded the model. The Gemma derivative is inspectable but does not repair the Vulkan device-loss path.

Methods and supporting files

  • Compatibility table

    Exact hashes, settings, repetitions, rates, standard deviation, and package peaks.

    compatibility-summary.csv
  • Compatibility notes

    What failed, what ran, and why the two cases are not one runtime benchmark.

    FOLLOWUP_RESULTS.md

Recorded setup

Threads
4
Prompt
128 tokens
Output
96 tokens
Batch
512 / 512 microbatch
Measured runs
5
Generation stddev
0.003291
Thermal ceiling
85 °C

Artifact SHA-256510408e8043ca1c741fe9a16088d47e8fa0d016033c6acf0c50c50c7c93b6530

Qwen3 0.6B
Q4_K_M
Ollama 0.32.1
CPU · Mean warm generation
6.788 tok/sn/a74 °CPublished resultOriginal CPU matrix
Open result details

About this model

Qwen3 0.6B is the smallest Qwen3 model in these tests. The 0.6B label describes its parameter count; Q4_K_M identifies the quantized file I ran. Its small size made it a useful starting point for testing CPU inference and Intel GPU offload on the X1S.

Family
Qwen3
Recorded size
0.6B

It was small enough to show the CPU, mixed host-operation, and full-Vulkan differences without crossing into the larger-model i915 failures.

What ran

Q4_K_M ran through Ollama 0.32.1 using CPU in Mean warm generation mode on Youyeetoo X1S.

Fastest row, least complete response on the single prompt.

These warm Ollama results belong together. They should not be used as the other half of the later llama-bench runtime comparison.

Methods and supporting files

Recorded setup

The full test page contains the shared controls and comparison boundary for this row.

Qwen3 1.7B
Q4_K_M
Ollama 0.32.1
CPU · Mean warm generation
3.129 tok/sn/a77 °CPublished resultOriginal CPU matrix
Open result details

About this model

Qwen3 1.7B is the next step up from the 0.6B model in the matched X1S tests. I used the Q4_K_M file in both CPU servers, then ran the same model through the three llama.cpp device modes. The two groups answer different questions, so their results are listed separately.

Family
Qwen3
Recorded size
1.7B

The original X1S work put it in the usable interactive tier, so it became the second clean model for checking whether the Vulkan pattern held beyond 0.6B.

What ran

Q4_K_M ran through Ollama 0.32.1 using CPU in Mean warm generation mode on Youyeetoo X1S.

Best interactive starting tier tested.

These warm Ollama results belong together. They should not be used as the other half of the later llama-bench runtime comparison.

Methods and supporting files

Recorded setup

The full test page contains the shared controls and comparison boundary for this row.

Qwen3 4B Instruct
Q4_K_M
Ollama 0.32.1
CPU · Mean warm generation
1.824 tok/sn/a77 °CPublished resultOriginal CPU matrix
Open result details

About this model

This is the instruction-tuned 4B Qwen3 entry. It appears in the X1S inference tests and the Home SOC reporting work on the Minisforum. The model name connects those records, while the file, hardware and settings on each row tell you which configuration actually ran.

Family
Qwen3
Recorded size
4B

It marks the point where the clean small-model Vulkan result stopped scaling into a reliable larger-model run on this software stack.

What ran

Q4_K_M ran through Ollama 0.32.1 using CPU in Mean warm generation mode on Youyeetoo X1S.

Patient local batch use.

These warm Ollama results belong together. They should not be used as the other half of the later llama-bench runtime comparison.

Methods and supporting files

Recorded setup

The full test page contains the shared controls and comparison boundary for this row.

Phi-4 Mini
Q4_K_M
Ollama 0.32.1
CPU · Mean warm generation
1.991 tok/sn/a77 °CPublished resultOriginal CPU matrix
Open result details

About this model

Phi-4 Mini gave me a second model family for the matched CPU test. Both runtimes loaded the Q4_K_M file, so I could compare the same workload beyond the Qwen models. Its later Vulkan failure belongs to the GPU test, not the completed CPU comparison.

Family
Phi-4
Recorded size
Mini

It provides a second model family inside the matched runtime result and a retained failure outside the clean Vulkan pair.

What ran

Q4_K_M ran through Ollama 0.32.1 using CPU in Mean warm generation mode on Youyeetoo X1S.

Patient local batch use.

These warm Ollama results belong together. They should not be used as the other half of the later llama-bench runtime comparison.

Methods and supporting files

Recorded setup

The full test page contains the shared controls and comparison boundary for this row.

Gemma 3 4B
Q4_K_M
Ollama 0.32.1
CPU · Mean warm generation
1.995 tok/sn/a77 °CPublished resultOriginal CPU matrix
Open result details

About this model

The Gemma 3 entry includes a separate text-only derivative made from the original artifact. That distinction matters when reproducing the run: the derivative completed true CPU, while the later Vulkan attempt still hit the device-loss path. Keep the file identity with the result.

Family
Gemma 3
Recorded size
4B

It records two different compatibility boundaries: converting the older multimodal artifact for current llama.cpp and the separate Vulkan failure that conversion did not fix.

What ran

Q4_K_M ran through Ollama 0.32.1 using CPU in Mean warm generation mode on Youyeetoo X1S.

Patient local batch use.

These warm Ollama results belong together. They should not be used as the other half of the later llama-bench runtime comparison.

Methods and supporting files

Recorded setup

The full test page contains the shared controls and comparison boundary for this row.

Qwen3 8B
Q4_K_M
Ollama 0.32.1
CPU · Mean warm generation
0.924 tok/sn/a80 °CPublished resultOriginal CPU matrix
Open result details

About this model

The 8B Qwen3 entry was useful for testing the upper end of what I could run on the 16 GB X1S. Loading and completing a CPU request was one result; the larger full-Vulkan attempt was a separate test with its own failure record.

Family
Qwen3
Recorded size
8B

It establishes that fitting in 16 GB and completing on CPU did not guarantee a stable full-GPU path.

What ran

Q4_K_M ran through Ollama 0.32.1 using CPU in Mean warm generation mode on Youyeetoo X1S.

Fit comfortably with sub-1 tok/s generation.

These warm Ollama results belong together. They should not be used as the other half of the later llama-bench runtime comparison.

Methods and supporting files

Recorded setup

The full test page contains the shared controls and comparison boundary for this row.

DeepSeek-R1 Distill Qwen 1.5B
W8A8 RKLLM
RKLLM 1.2.1
NPU · 50 state-capitals prompt
11.5 tok/sn/an/aPublished resultNova NPU models
Open result details

About this model

This is the DeepSeek-R1 model distilled into a Qwen 1.5B model, tested as W8A8 on the Nova NPU. I asked for the same state-capitals list used in the other Nova runs and retained what the answer actually did alongside its generation rate.

Family
DeepSeek-R1
Recorded size
1.5B

It is the clearest example in the Hub of why throughput and useful output cannot be treated as the same result.

What ran

W8A8 RKLLM ran through RKLLM 1.2.1 using NPU in 50 state-capitals prompt mode on Indiedroid Nova.

Started fast, then invented cities around state seven.

The three Nova rows share the local test. Raspberry Pi numbers in the article came from outside references with different runtime and quantization.

Recorded setup

The full test page contains the shared controls and comparison boundary for this row.

Qwen 2.5 3B Instruct
W8A8 RKLLM
RKLLM 1.2.1
NPU · 50 state-capitals prompt
7 tok/sn/an/aPublished resultNova NPU models
Open result details

About this model

Qwen 2.5 3B Instruct ran as a W8A8 model through RKLLM on the Nova. The recorded task was a state-capitals list, so this page keeps both the generation rate and the observed answer result instead of treating throughput as answer quality.

Family
Qwen 2.5
Recorded size
3B

It was slower than the smaller DeepSeek row but produced the useful answer on the shared prompt.

What ran

W8A8 RKLLM ran through RKLLM 1.2.1 using NPU in 50 state-capitals prompt mode on Indiedroid Nova.

Returned all 50 state capitals correctly.

The three Nova rows share the local test. Raspberry Pi numbers in the article came from outside references with different runtime and quantization.

Recorded setup

The full test page contains the shared controls and comparison boundary for this row.

Llama 3.1 8B Instruct
W8A8 RKLLM
RKLLM 1.2.1
NPU · 50 state-capitals prompt
3.72 tok/sn/an/aPublished resultNova NPU models
Open result details

About this model

Llama 3.1 8B Instruct connects the Nova NPU run with the Pi 5 references from the original article. The Nova measurement is mine; the Pi rows are outside references with their own sources and test conditions.

Family
Llama 3.1
Recorded size
8B

It connects Trevor-measured Nova data with a clearly separated published Pi reference without presenting the two methods as a matched hardware contest.

What ran

W8A8 RKLLM ran through RKLLM 1.2.1 using NPU in 50 state-capitals prompt mode on Indiedroid Nova.

Measured Nova NPU result.

The three Nova rows share the local test. Raspberry Pi numbers in the article came from outside references with different runtime and quantization.

Recorded setup

The full test page contains the shared controls and comparison boundary for this row.

DeepSeek-R1 Distill Qwen 1.5B
Q4 reference
llama.cpp
CPU · Published reference range
about 6 to 8 tok/sn/an/aExternal referencePi 5 references
Open result details

About this model

This is the DeepSeek-R1 model distilled into a Qwen 1.5B model, tested as W8A8 on the Nova NPU. I asked for the same state-capitals list used in the other Nova runs and retained what the answer actually did alongside its generation rate.

Family
DeepSeek-R1
Recorded size
1.5B

It is the clearest example in the Hub of why throughput and useful output cannot be treated as the same result.

What ran

Q4 reference ran through llama.cpp using CPU in Published reference range mode on Raspberry Pi 5.

Approximate published range. Not Trevor-measured.

These are external references with different runtime, quantization, and hardware approach. A matched Trevor-run Pi 5 test has not been completed.

Recorded setup

The full test page contains the shared controls and comparison boundary for this row.

Qwen 2.5 3B Instruct
Q4 reference
llama.cpp
CPU · Published reference range
about 4 to 5 tok/sn/an/aExternal referencePi 5 references
Open result details

About this model

Qwen 2.5 3B Instruct ran as a W8A8 model through RKLLM on the Nova. The recorded task was a state-capitals list, so this page keeps both the generation rate and the observed answer result instead of treating throughput as answer quality.

Family
Qwen 2.5
Recorded size
3B

It was slower than the smaller DeepSeek row but produced the useful answer on the shared prompt.

What ran

Q4 reference ran through llama.cpp using CPU in Published reference range mode on Raspberry Pi 5.

Approximate published range. Not Trevor-measured.

These are external references with different runtime, quantization, and hardware approach. A matched Trevor-run Pi 5 test has not been completed.

Recorded setup

The full test page contains the shared controls and comparison boundary for this row.

Llama 3.1 8B Instruct
Q4 reference
llama.cpp
CPU · Jeff Geerling published result
1.99 tok/sn/an/aExternal referencePi 5 references
Open result details

About this model

Llama 3.1 8B Instruct connects the Nova NPU run with the Pi 5 references from the original article. The Nova measurement is mine; the Pi rows are outside references with their own sources and test conditions.

Family
Llama 3.1
Recorded size
8B

It connects Trevor-measured Nova data with a clearly separated published Pi reference without presenting the two methods as a matched hardware contest.

What ran

Q4 reference ran through llama.cpp using CPU in Jeff Geerling published result mode on Raspberry Pi 5.

Cited result. Not Trevor-measured.

These are external references with different runtime, quantization, and hardware approach. A matched Trevor-run Pi 5 test has not been completed.

Recorded setup

The full test page contains the shared controls and comparison boundary for this row.

Protectli V1610: Detection, Inline Block and Rollback

I followed a harmless request from my Windows client into Suricata, changed only its test signature to drop, and then restored it to alert. HTTPS and DNS controls checked that ordinary traffic still worked while the selected request was blocked.

This is a physical client-to-Vault check with exact connection evidence. The test signature verifies this inspection path; it is not a detection-rate study or inspection of decrypted HTTPS payloads.

Harmless fixture detected

Physical path · alert-only

Published result

Measured on Protectli V1610 · Owned Vault test

Response body
39 bytes
Exact returned fixture body, matched to the source record.

HTTP 200 returned the exact 39-byte UID body, and the original EVE record identified SID 2100498 with action allowed for the matching connection.

Setup and original evidence

Protectli V1610 · OPNsense 26.7.5 / Suricata 8.0.7_1 · Owned Vault test · Physical path · alert-only

Methods and supporting files

Protectli V1610: Detection, Inline Block and Rollback →

Selected request blocked

Physical path · inline Netmap drop

Published result

Measured on Protectli V1610 · Owned Vault test

Response body
0 bytes
No fixture response body received.
Client timeout
10 seconds
Bounded curl request; the timeout alone is not the blocking oracle.

curl timed out after ten seconds without a response body, while the exact corresponding EVE connection was recorded as blocked. Both observations are required for this result.

Setup and original evidence

Protectli V1610 · OPNsense 26.7.5 / Suricata 8.0.7_1 · Owned Vault test · Physical path · inline Netmap drop

Methods and supporting files

Protectli V1610: Detection, Inline Block and Rollback →

Ordinary traffic during the block

Physical path · HTTPS and DNS controls

Published result

Measured on Protectli V1610 · Owned Vault test

Benign control types passed
2 of 2
HTTPS and direct Vault DNS; not two independent attack cases. (control types)

Certificate-validated HTTPS and a DNS lookup through the Vault both passed while the selected fixture rule was active.

Setup and original evidence

Protectli V1610 · OPNsense 26.7.5 / Suricata 8.0.7_1 · Owned Vault test · Physical path · HTTPS and DNS controls

Methods and supporting files

Protectli V1610: Detection, Inline Block and Rollback →

Response restored after rollback

Physical path · test rule returned to alert

Published result

Measured on Protectli V1610 · Owned Vault test

Restored response body
39 bytes
Same harmless fixture after the selected action was reverted.

The repeated UID request returned HTTP 200 and 39 bytes, with an exact allowed EVE match and the generated signature action back at alert.

Setup and original evidence

Protectli V1610 · OPNsense 26.7.5 / Suricata 8.0.7_1 · Owned Vault test · Physical path · test rule returned to alert

Methods and supporting files

Protectli V1610: Detection, Inline Block and Rollback →

Installed rules and retained policy

Final installed snapshot

Published result

Measured on Protectli V1610 · Owned Vault test

Enabled categories
10 categories
Selected installed snapshot.
Active rules
37125 rules
Native validation exit 0.
Alert rules
37121 rules
Final generated actions.
Drop rules
4 rules
Selected Critical TLS C2 rules; UID restored to alert.

Native validation exited successfully with dependency-complete selected rules. The final snapshot held 37,125 active rules: 37,121 alerts and four drops across ten enabled categories. Feed updates can change these counts.

Setup and original evidence

Protectli V1610 · OPNsense 26.7.5 / Suricata 8.0.7_1 · Owned Vault test · Final installed snapshot

Methods and supporting files

Protectli V1610: Detection, Inline Block and Rollback →

Management and recovery configuration

Recorded appliance configuration

Published result

Measured on Protectli V1610 · Owned Vault test

Matched configuration export
38989 bytes
Original device/local SHA256 comparison.
Retained boot environments
5 environments
Same SSD, separate from the off-device XML.

Listener, rule and console checks confirmed LAN-only HTTPS management, disabled SSH and password-protected console access. The off-device XML matched its device-side SHA256; five boot environments were retained on the SSD. The XML stays private because it contains secrets, and same-disk boot environments do not replace it.

Setup and original evidence

Protectli V1610 · OPNsense 26.7.5 / Suricata 8.0.7_1 · Owned Vault test · Recorded appliance configuration

Methods and supporting files

Protectli V1610: Detection, Inline Block and Rollback →

Protectli V1610: Isolated PF Packet Checks

I used three temporary FreeBSD VNET stacks on the Vault to check a small PF policy with real packets, captures and counters. The eight cases cover allowed controls, NAT, unsolicited WAN traffic, spoofing and finite bursts.

The authored policy mirrors core LAN pass, WAN deny, NAT and anti-spoof behavior. It does not import every OPNsense anchor or table, and the finite bursts are blocking checks rather than a DoS-capacity measurement.

HTTP and NAT control

Isolated VNET · core PF mirror

Published result

Measured on Protectli V1610 · Virtual packet exchange on the Vault

Response body
39 bytes
Exact body/hash, with observed NAT peer.

HTTP 200 returned the exact 39-byte body/hash; allowed LAN traffic and the NAT peer were verified.

Setup and original evidence

Protectli V1610 · FreeBSD VNET / authored PF mirror · Virtual packet exchange on the Vault · Isolated VNET · core PF mirror

Methods and supporting files

  • Packet-exchange matrix

    Inputs, counts, isolation, failures and cleanup checks.

    SIMULATED_ACCEPTANCE_2026-10-05.md
Protectli V1610: Isolated PF Packet Checks →

HTTPS control

Isolated VNET · core PF mirror

Published result

Measured on Protectli V1610 · Virtual packet exchange on the Vault

Response body
39 bytes
Encrypted transport control; no TLS decryption.

The same endpoint and body/hash passed over HTTPS, with no plaintext UID string in captured TCP payloads.

Setup and original evidence

Protectli V1610 · FreeBSD VNET / authored PF mirror · Virtual packet exchange on the Vault · Isolated VNET · core PF mirror

Methods and supporting files

  • Packet-exchange matrix

    Inputs, counts, isolation, failures and cleanup checks.

    SIMULATED_ACCEPTANCE_2026-10-05.md
Protectli V1610: Isolated PF Packet Checks →

LAN ICMP control

Isolated VNET · core PF mirror

Published result

Measured on Protectli V1610 · Virtual packet exchange on the Vault

Echo replies
3 of 3
Three sent requests. (replies)
Allow-counter packets
6 packets
Requests plus replies.

Three requests received three replies, with six packets on the allow counter.

Setup and original evidence

Protectli V1610 · FreeBSD VNET / authored PF mirror · Virtual packet exchange on the Vault · Isolated VNET · core PF mirror

Methods and supporting files

  • Packet-exchange matrix

    Inputs, counts, isolation, failures and cleanup checks.

    SIMULATED_ACCEPTANCE_2026-10-05.md
Protectli V1610: Isolated PF Packet Checks →

Unsolicited WAN TCP ports

Isolated VNET · core PF mirror

Published result

Measured on Protectli V1610 · Virtual packet exchange on the Vault

Denied SYN packets
8 of 8
Eight distinct destination-port probes. (packets)
Forwarded packets
0 packets
Observed virtual LAN capture.

Eight distinct SYN packets arrived, caused eight deny increments and were not forwarded to the virtual LAN.

Setup and original evidence

Protectli V1610 · FreeBSD VNET / authored PF mirror · Virtual packet exchange on the Vault · Isolated VNET · core PF mirror

Methods and supporting files

  • Packet-exchange matrix

    Inputs, counts, isolation, failures and cleanup checks.

    SIMULATED_ACCEPTANCE_2026-10-05.md
Protectli V1610: Isolated PF Packet Checks →

WAN source-spoof check

Isolated VNET · core PF mirror

Published result

Measured on Protectli V1610 · Virtual packet exchange on the Vault

Anti-spoof counter
5 of 5
Five authored UDP datagrams. (packets)

Five UDP datagrams with a LAN-range source alias arrived on virtual WAN and caused five anti-spoof increments.

Setup and original evidence

Protectli V1610 · FreeBSD VNET / authored PF mirror · Virtual packet exchange on the Vault · Isolated VNET · core PF mirror

Methods and supporting files

  • Packet-exchange matrix

    Inputs, counts, isolation, failures and cleanup checks.

    SIMULATED_ACCEPTANCE_2026-10-05.md
Protectli V1610: Isolated PF Packet Checks →

Finite WAN UDP burst

Isolated VNET · core PF mirror

Published result

Measured on Protectli V1610 · Virtual packet exchange on the Vault

Denied datagrams
200 of 200
Finite burst at configured 100 packets/second. (packets)
Forwarded packets
0 packets
Observed virtual LAN capture.

All 200 packets at a configured 100 packets per second reached the deny counter, with none forwarded.

Setup and original evidence

Protectli V1610 · FreeBSD VNET / authored PF mirror · Virtual packet exchange on the Vault · Isolated VNET · core PF mirror

Methods and supporting files

  • Packet-exchange matrix

    Inputs, counts, isolation, failures and cleanup checks.

    SIMULATED_ACCEPTANCE_2026-10-05.md
Protectli V1610: Isolated PF Packet Checks →

Finite WAN SYN burst

Isolated VNET · core PF mirror

Published result

Measured on Protectli V1610 · Virtual packet exchange on the Vault

Denied SYN packets
100 of 100
Finite connection-attempt fixture. (packets)
Forwarded packets
0 packets
Observed virtual LAN capture.

One hundred finite attempts produced 100 captured SYNs and 100 deny increments, with none forwarded.

Setup and original evidence

Protectli V1610 · FreeBSD VNET / authored PF mirror · Virtual packet exchange on the Vault · Isolated VNET · core PF mirror

Methods and supporting files

  • Packet-exchange matrix

    Inputs, counts, isolation, failures and cleanup checks.

    SIMULATED_ACCEPTANCE_2026-10-05.md
Protectli V1610: Isolated PF Packet Checks →

WAN ICMP deny

Isolated VNET · core PF mirror

Published result

Measured on Protectli V1610 · Virtual packet exchange on the Vault

Denied requests
3 of 3
Three captured echo requests. (packets)
Forwarded packets
0 packets
Observed virtual LAN capture.

Three echo requests arrived on virtual WAN, caused three deny increments and were not forwarded.

Setup and original evidence

Protectli V1610 · FreeBSD VNET / authored PF mirror · Virtual packet exchange on the Vault · Isolated VNET · core PF mirror

Methods and supporting files

  • Packet-exchange matrix

    Inputs, counts, isolation, failures and cleanup checks.

    SIMULATED_ACCEPTANCE_2026-10-05.md
Protectli V1610: Isolated PF Packet Checks →

Protectli V1610: Suricata Regression and Policy Replays

I kept engine regressions separate from replays of the installed policy. That distinction matters here: the upstream regression cases passed, while the installed rules produced zero alerts on 20 unchanged upstream captures.

These are offline engine runs on the Vault. Upstream cases carry their own rules and assertions; installed-policy runs use the appliance snapshot. Offline drop records show rule selection, while physical-wire blocking is documented in the separate inline test.

Upstream engine regressions

Upstream fixtures and their own rules

Published result

Measured on Protectli V1610 · Owned Vault test

Passed cases
23 cases
Distinct executed upstream cases.
Skipped cases
1 case
SSH fixture requires Suricata 9.

23 distinct cases passed. One SSH case was skipped because it requires Suricata 9; it is not included as a pass.

Setup and original evidence

Protectli V1610 · OPNsense 26.7.5 / Suricata 8.0.7_1 · Owned Vault test · Upstream fixtures and their own rules

Methods and supporting files

  • Replay results and corrections

    Engine cases, installed-policy outcomes, checksum-only derivatives and exact TLS expectations.

    SIMULATED_ACCEPTANCE_2026-10-05.md
  • Pinned upstream suite

    Independent engine regression fixtures and assertions.

    ddab1fde8de8dca2eb53f12e61a7aa4a4a4f133a
Protectli V1610: Suricata Regression and Policy Replays →

Installed policy on upstream captures

Unchanged PCAPs · appliance rule snapshot

Published result

Measured on Protectli V1610 · Owned Vault test

Completed replays
20 of 20
Unchanged upstream PCAPs. (captures)
Observed alerts
0 alerts
Actual installed-policy outcome.

All 20 replays completed with zero alerts. These captures and the installed policy did not produce alert coverage in this run.

Setup and original evidence

Protectli V1610 · OPNsense 26.7.5 / Suricata 8.0.7_1 · Owned Vault test · Unchanged PCAPs · appliance rule snapshot

Methods and supporting files

  • Replay results and corrections

    Engine cases, installed-policy outcomes, checksum-only derivatives and exact TLS expectations.

    SIMULATED_ACCEPTANCE_2026-10-05.md
  • Pinned upstream suite

    Independent engine regression fixtures and assertions.

    ddab1fde8de8dca2eb53f12e61a7aa4a4a4f133a
Protectli V1610: Suricata Regression and Policy Replays →

Original virtual-capture replay

Original invalid TCP checksums retained

Published result

Measured on Protectli V1610 · Owned Vault test

Original cases
8 captures
Original packets preserved.
UID alerts
1 alert
Allowed SID 2100498 from the original HTTP replay.

The HTTP UID fixture produced one allowed signature alert and other cases produced no alerts. Invalid TCP checksums prevent using this original replay to infer HTTPS stream inspection.

Setup and original evidence

Protectli V1610 · OPNsense 26.7.5 / Suricata 8.0.7_1 · Owned Vault test · Original invalid TCP checksums retained

Methods and supporting files

  • Replay results and corrections

    Engine cases, installed-policy outcomes, checksum-only derivatives and exact TLS expectations.

    SIMULATED_ACCEPTANCE_2026-10-05.md
  • Pinned upstream suite

    Independent engine regression fixtures and assertions.

    ddab1fde8de8dca2eb53f12e61a7aa4a4a4f133a
Protectli V1610: Suricata Regression and Policy Replays →

Checksum-controlled replay

Only invalid TCP checksum fields changed

Published result

Measured on Protectli V1610 · Owned Vault test

Completed corrected replays
8 of 8
Byte-audited checksum-only derivatives. (captures)
Invalid TCP checksums
0 checksums
Replay engine counters.
HTTP allowed alerts
3 alerts
Includes SID 2100498.
HTTPS TLS events
1 event
TLS-parser evidence; zero UID alerts.

All eight corrected replays completed with zero invalid TCP checksums. HTTP produced three allowed alerts including the UID signature; HTTPS produced one TLS event without a UID alert.

Setup and original evidence

Protectli V1610 · OPNsense 26.7.5 / Suricata 8.0.7_1 · Owned Vault test · Only invalid TCP checksum fields changed

Methods and supporting files

  • Replay results and corrections

    Engine cases, installed-policy outcomes, checksum-only derivatives and exact TLS expectations.

    SIMULATED_ACCEPTANCE_2026-10-05.md
  • Pinned upstream suite

    Independent engine regression fixtures and assertions.

    ddab1fde8de8dca2eb53f12e61a7aa4a4a4f133a
Protectli V1610: Suricata Regression and Policy Replays →

Four enabled TLS drop rules

Inert offline SNI positive and negative fixtures

Published result

Measured on Protectli V1610 · Owned Vault test

Expected drop matches
4 of 4
Four exact-SNI positives. (fixtures)
Expected nonmatches
5 of 5
Four suffix negatives and one benign control. (fixtures)

Four exact names produced blocked matches and drop records. Four suffix negatives and one reserved-domain control avoided those matches; all nine met the authored expectations.

Setup and original evidence

Protectli V1610 · OPNsense 26.7.5 / Suricata 8.0.7_1 · Owned Vault test · Inert offline SNI positive and negative fixtures

Methods and supporting files

  • Replay results and corrections

    Engine cases, installed-policy outcomes, checksum-only derivatives and exact TLS expectations.

    SIMULATED_ACCEPTANCE_2026-10-05.md
  • Pinned upstream suite

    Independent engine regression fixtures and assertions.

    ddab1fde8de8dca2eb53f12e61a7aa4a4a4f133a
Protectli V1610: Suricata Regression and Policy Replays →

Protectli V1610: Routed Download Observations

I measured short, certificate-validated downloads through the final IDS and IPS configurations using the same fixed endpoint. The individual trials stay here alongside their medians because the Internet path varied between requests.

These rates include connection and TLS setup. Upstream conditions, endpoint behavior and other client traffic were not isolated, so the difference does not measure inspection overhead or maximum forwarding capacity.

PCAP IDS

Routed Internet · three complete 25 MB requests

Published result

Measured on Protectli V1610 · Owned client routed through the Vault

Median rate
537.017 Mbps
Three complete trials, including connection and TLS setup.
Complete trials
3 of 3
25,000,000 bytes each after one 1,000,000-byte warmup. (requests)
Sampled core maximum
60 °C
Separate native resource sampling; may miss short request peaks.

Individual payload rates were 537.017, 533.622, 549.84 Mbps. Every request completed under the same final-platform protocol; the median describes this endpoint/path observation.

Setup and original evidence

Protectli V1610 · OPNsense 26.7.5 / Suricata 8.0.7_1 · Owned client routed through the Vault · Routed Internet · three complete 25 MB requests

Methods and supporting files

Protectli V1610: Routed Download Observations →

Netmap IPS

Routed Internet · three complete 25 MB requests

Published result

Measured on Protectli V1610 · Owned client routed through the Vault

Median rate
493.027 Mbps
Three complete trials, including connection and TLS setup.
Complete trials
3 of 3
25,000,000 bytes each after one 1,000,000-byte warmup. (requests)
Sampled core maximum
48 °C
Separate native resource sampling; may miss short request peaks.

Individual payload rates were 493.027, 480.639, 623.063 Mbps. Every request completed under the same final-platform protocol; the median describes this endpoint/path observation.

Setup and original evidence

Protectli V1610 · OPNsense 26.7.5 / Suricata 8.0.7_1 · Owned client routed through the Vault · Routed Internet · three complete 25 MB requests

Methods and supporting files

Protectli V1610: Routed Download Observations →

Protectli V1610: LAN Endpoint and Capture Counters

I also transferred fixed payloads from a bounded server on the Vault to the owned LAN client, then retained the engine counters with their actual observation windows. Successful downloads and complete packet inspection are different measurements here.

This workload terminates on the Vault, so it is not WAN forwarding throughput. PCAP kernel drops span its full runtime without an isolated pre-LAN boundary; the Netmap stream-discard snapshot uses a different window and cannot serve as a matched loss comparison.

PCAP IDS endpoint

LAN-terminating server · four 128 MiB payloads

Published result

Measured on Protectli V1610 · Owned Vault test

Median payload rate
2370.291 Mbps
Terminating endpoint, approximate client timer; not forwarded WAN throughput.
Complete payloads
4 of 4
134,217,728 bytes each. (transfers)
Sampled core maximum
60 °C
Native samples during this endpoint workload.

Four complete rates were 2370.291 Mbps each under the recorded timer. The sampled core maximum was 60 °C.

Setup and original evidence

Protectli V1610 · OPNsense 26.7.5 / Suricata 8.0.7_1 · Owned Vault test · LAN-terminating server · four 128 MiB payloads

Methods and supporting files

Protectli V1610: LAN Endpoint and Capture Counters →

Netmap IPS endpoint

LAN-terminating server · four 128 MiB payloads

Published result

Measured on Protectli V1610 · Owned Vault test

Median payload rate
848.137 Mbps
Terminating endpoint, approximate client timer; not forwarded WAN throughput.
Complete payloads
4 of 4
134,217,728 bytes each. (transfers)
Sampled core maximum
55 °C
Native samples during this endpoint workload.

Four complete rates were 848.137, 827.866, 848.808 and 848.137 Mbps. The sampled core maximum was 55 °C.

Setup and original evidence

Protectli V1610 · OPNsense 26.7.5 / Suricata 8.0.7_1 · Owned Vault test · LAN-terminating server · four 128 MiB payloads

Methods and supporting files

Protectli V1610: LAN Endpoint and Capture Counters →

Capture and discard observations

Different engine windows · preserve each denominator

Published result

Measured on Protectli V1610 · Owned Vault test

PCAP kernel drops
313268 packets
Cumulative 962,578 packets across the full PCAP runtime.
Netmap stream discards
188 packets
610,614 packets in the separate 5m14s final snapshot.

PCAP cumulative counters cover 40+ minutes without a pre-LAN boundary. Netmap counters cover 5m14s after restart; its 188 discards were stream errors of unproven cause. No emitted kernel-drop counter is not a zero-loss certificate.

Setup and original evidence

Protectli V1610 · OPNsense 26.7.5 / Suricata 8.0.7_1 · Owned Vault test · Different engine windows · preserve each denominator

Methods and supporting files

Protectli V1610: LAN Endpoint and Capture Counters →

Home SOC: Evidence Collection, Retention and Recovery

The firewall records also need to survive review and a restart. These checks cover Vault event forwarding, the Windows evidence tools, rolling storage and recovery after sign-in, with the maintenance gaps and failed readings kept in the record.

This is a two-machine workflow: the Vault supplies events and native observations, while Windows receives, indexes and serves them. Scheduled recovery requires Windows sign-in, and USB sampling needs an authenticated appliance console after a Vault reboot. The Hub is a saved result record, not a live health monitor.

Simulated events through the real handlers

Isolated loopback receiver and evidence builder

Published result

Tested system: Protectli Vault + Windows evidence host · Two-machine evidence workflow; isolated host replay

Replay cases
17 cases
Actual simulated engine outputs.
Received datagrams
153 datagrams
Separate loopback receiver.
Verified original references
7 references
Exact source checks.
Pipeline and fault checks
75 tests
Historical isolated software suite; distinct from the later 250-check retention suite.

17 cases delivered 153 datagrams with the expected SID/action counts; seven original references verified and the report/source routes returned HTTP 200. These were replay receipts, without model inference. The separate local pipeline/fault lane passed 75 software tests using temporary stores and mocked failure conditions.

Setup and original evidence

Protectli V1610 · Windows Python receiver, evidence builder and dashboard · Two-machine evidence workflow; isolated host replay · Isolated loopback receiver and evidence builder

Methods and supporting files

Home SOC: Evidence Collection, Retention and Recovery →

Activated rolling storage

Current policy · fixture-tested expiry and live activation

Published result

Tested system: Protectli Vault + Windows evidence host · Windows evidence storage

Preserved setup baseline
310110946 bytes
Nine original members, including failures; immutable baseline separate from ordinary expiry.
Hot budget
1024 MiB
1 GiB originals, active rollover at 32 MiB.
Cold budget
4096 MiB
4 GiB compressed sealed segments.
Ordinary sealed-segment window
7 days
After sealing; capacity may shorten it. Disposable-fixture expiry test, not a full live seven-day observation.

The live migration preserved all setup bytes and returned new Vault receipts without a full/storage-error state. Hot originals roll at 32 MiB into a verified compressed cold tier; ordinary sealed segments expire seven days after sealing or earlier under capacity pressure.

Setup and original evidence

Protectli V1610 · Windows Python / rolling-v2 / SQLite · Windows evidence storage · Current policy · fixture-tested expiry and live activation

Methods and supporting files

Home SOC: Evidence Collection, Retention and Recovery →

Saved review sources and retrieval

Separate pins · exact hashes · visible expiry

Published result

Tested system: Protectli Vault + Windows evidence host · Windows evidence storage

Pinned-source budget
64 MiB
Separate from hot/cold ordinary storage.
Pinned-record limit
4096 records
New note refused at the limit, without stopping collection.
Pre-activation regression checks
250 tests
Software/fixture checks, not independent incidents.

New operator notes preserve their cited raw records under a separate 64 MiB / 4,096-record budget. A full pin budget refuses another note while collection continues; an expired unpreserved source returns HTTP 410. The pre-activation suite passed 250 tests, including storage and recovery fixtures.

Setup and original evidence

Protectli V1610 · Windows Python / rolling-v2 / SQLite · Windows evidence storage · Separate pins · exact hashes · visible expiry

Methods and supporting files

Home SOC: Evidence Collection, Retention and Recovery →

Actual reboot and sign-in recovery

Recorded appliance reboot and newer Windows boot

Published result

Tested system: Protectli Vault + Windows evidence host · Vault + Windows sign-in recovery

Vault login prompt
59 seconds
Approximate observed appliance reboot interval, separate from full application readiness.

The Vault reached its login prompt in about 59 seconds. After Windows reboot and sign-in, recovery started the owned components and the next check reused them without duplicates. Original log prefix, notes and backup hashes matched; certificate-valid HTTPS, direct Vault DNS and exact UID/EVE correlation passed.

Setup and original evidence

Protectli V1610 · Vault boot / Windows Task Scheduler and PowerShell · Vault + Windows sign-in recovery · Recorded appliance reboot and newer Windows boot

Methods and supporting files

Home SOC: Evidence Collection, Retention and Recovery →

Scheduled dashboard restoration

Later ownership-receipt repair, without a new reboot

Published result

Tested system: Protectli Vault + Windows evidence host · Windows sign-in and five-minute recovery

A manual receiver launch had left a stale recovery-owner receipt. After exact ownership reconciliation, the scheduled task restored the dashboard and reporting runtime, then repeated the restoration after an idle dashboard stop without stopping collection. Original files/prefixes verified. This repair was not a new sign-out/sign-in or reboot test.

Setup and original evidence

Protectli V1610 · Windows Task Scheduler / PowerShell 7 · Windows sign-in and five-minute recovery · Later ownership-receipt repair, without a new reboot

Methods and supporting files

Home SOC: Evidence Collection, Retention and Recovery →

Retained operation and observation gaps

Historical snapshot, not current live health

Published result

Tested system: Protectli Vault + Windows evidence host · Vault + Windows evidence workflow

Timestamped observations
352 observations
Retained Oct 5–7 snapshot; not independent incidents.
Sampled core minimum
30 °C
Operating observations, separate from guarded load.
Sampled core maximum
56 °C
Operating observations, separate from the 62 °C load peak.
Observation gaps over ten minutes
5 gaps
27 min, 12 min, 11h57, 20 min and 12 min.

352 observations recorded sampled cores at 30–56 °C, with no sampled full/storage-error/capacity-warning state. Five gaps exceeded ten minutes, including an 11h57 host interruption; one native reading had unknown fields and another was stale. Maintenance and UDP receipt uncertainty remain visible.

Setup and original evidence

Protectli V1610 · Vault native sensors / Windows observation journal · Vault + Windows evidence workflow · Historical snapshot, not current live health

Methods and supporting files

Home SOC: Evidence Collection, Retention and Recovery →

Clock correction and event timing

Point-in-time host/appliance clock comparison

Published result

Tested system: Protectli Vault + Windows evidence host · Vault + Windows evidence workflow

Post-repair clock difference
46 ms
Approximate independent host/appliance comparison after successful resync.

The Windows time-service repair completed a successful resync and cleared its synchronization warning. A direct comparison then showed about 46 ms difference from the Vault. Earlier records with roughly 20 seconds of skew stayed unchanged; these offsets are not network latency or a clock-drift study.

Setup and original evidence

Protectli V1610 · Windows W32Time / Vault clock · Vault + Windows evidence workflow · Independent clock check after repair

Methods and supporting files

Home SOC: Evidence Collection, Retention and Recovery →

Protectli V1610: Bounded CPU Thermal Check

Four owned CPU-load processes completed the 180-second check with five-second core-temperature sampling. The peak was 62 °C, followed by recorded cooling and process cleanup.

Thirty-six samples from one short load, not independent thermal trials. This is a CPU-core observation, not case-surface temperature, thermal equilibrium, longevity or an overheating guarantee for every environment.

Protectli V1610 CPU cores

Four owned load processes

Completed bounded thermal check

Measured on Protectli V1610 · Pentium Silver N6005

Peak core temperature
62 °C
Highest recorded core reading across 36 samples
Sample count
36 samples
5-second sampling cadence; one load run
Start to cleanup
181.132 seconds
180-second requested load plus cleanup
Thermal stop bound
80 °C
Guard threshold; native controls retained

Highest core 62 °C, final readings 53/53/53/52 °C, cooldown 47 °C. No thermal stop; all owned children exited. This does not measure thermal equilibrium or case surface.

Setup and original evidence

Protectli V1610 · Native FreeBSD core sensors · Pentium Silver N6005 · 180-second bounded CPU load

Methods and supporting files

  • Thermal results and method

    Exact workload, samples, cutoff, cleanup, chart discrepancy and thermal limitations.

    PERFORMANCE_RESULTS.md
  • Published thermal results

    Exact duration, all end readings, recovery and the unresolved browser CPU-percentage discrepancy.

    PERFORMANCE_RESULTS.md
Protectli V1610: Bounded CPU Thermal Check →

Home SOC: Four Models with Default Sampling

Four models answered the same saved log summaries. This group contains two tasks: structured reports with a two-minute deadline, and written reports with a five-minute deadline. The sampling settings use each model's defaults.

Each model received 12 structured tasks three times and 6 written tasks twice. Repeats test consistency on those tasks; they are not new incidents. Compare completion and explanations within the same task and settings. These runs do not measure each model's best possible performance.

Qwen3 4B Instruct

Structured report; default sampling

Partial result

Measured on Minisforum MS-S1 MAX · CPU

Finished reports
30 of 36
12 fixed log summaries, each asked 3 times. A finished report completed within 120 seconds and passed the report validator. (answers)
Passed full answer checklist
0 of 30
10 summaries contain alerts, each asked 3 times. A pass needs a finished answer, expected explanations, valid list lengths, no repeated selections/citations and the required review priority. (answers)
Expected explanations selected
36 of 63
21 expected explanation items across those 10 summaries, repeated 3 times. This counts selected items, not whole answers or new discoveries. (selections)

6 answers stopped at the 700-token output cap. The full answer checklist is stricter than completion; failing it does not mean every part of the answer was wrong.

Setup and original evidence

This is the instruction-tuned 4B Qwen3 entry. It appears in the X1S inference tests and the Home SOC reporting work on the Minisforum. The model name connects those records, while the file, hardware and settings on each row tell you which configuration actually ran.

Family
Qwen3
Recorded size
4B

Minisforum MS-S1 MAX · Ollama 0.35.1 · CPU · Native structured profile

Context window: 4,096 tokens for input and output together. CPU-thread setting: 2; this is a runtime setting, not the host's core count.

Installed artifact digest: 0edcdef34593eac1aa2be9c7d06c432dcf81945adca5eca2f27662c18f168ba0

Methods and supporting files

  • Expanded outcomes

    Native, simulation and common-profile phases, including written defects and withheld responses.

    MODEL_COMPARISON_EXPANDED_RESULTS.md
  • Offline verification

    Request hashes, frozen manifests and the boundaries of mechanical verification.

    MODEL_STUDY_VERIFICATION.md
Home SOC: Four Models with Default Sampling →

Qwen3 4B Instruct

Written report; default sampling

Partial result

Measured on Minisforum MS-S1 MAX · CPU

Finished reports
4 of 12
6 summaries with alerts, each asked twice. Only naturally finished answers count here. (answers)
Stopped at the output cap
8 of 12
These answers returned text but reached the 700-token output limit before finishing. None of the written requests exceeded its 300-second deadline. (answers)
Finished answers with a major factual error
0 of 4
No delivered answer was rejected for a major factual error in the recorded review. Other shortcomings are documented; this is not a complete accuracy score. (answers)

4 answers finished and 8 stopped at the output cap. The completed answers still have recorded shortcomings, including citations and explanation quality.

Setup and original evidence

This is the instruction-tuned 4B Qwen3 entry. It appears in the X1S inference tests and the Home SOC reporting work on the Minisforum. The model name connects those records, while the file, hardware and settings on each row tell you which configuration actually ran.

Family
Qwen3
Recorded size
4B

Minisforum MS-S1 MAX · Ollama 0.35.1 · CPU · Native written profile

Context window: 4,096 tokens for input and output together. CPU-thread setting: 2; this is a runtime setting, not the host's core count.

Installed artifact digest: 0edcdef34593eac1aa2be9c7d06c432dcf81945adca5eca2f27662c18f168ba0

Methods and supporting files

  • Expanded outcomes

    Native, simulation and common-profile phases, including written defects and withheld responses.

    MODEL_COMPARISON_EXPANDED_RESULTS.md
  • Offline verification

    Request hashes, frozen manifests and the boundaries of mechanical verification.

    MODEL_STUDY_VERIFICATION.md
Home SOC: Four Models with Default Sampling →

Qwen3.5 4B

Structured report; default sampling

Partial result

Measured on Minisforum MS-S1 MAX · CPU

Finished reports
36 of 36
12 fixed log summaries, each asked 3 times. A finished report completed within 120 seconds and passed the report validator. (answers)
Passed full answer checklist
3 of 30
10 summaries contain alerts, each asked 3 times. A pass needs a finished answer, expected explanations, valid list lengths, no repeated selections/citations and the required review priority. (answers)
Expected explanations selected
15 of 63
21 expected explanation items across those 10 summaries, repeated 3 times. This counts selected items, not whole answers or new discoveries. (selections)

All 36 reports finished, though most missed expected explanations. The full answer checklist is stricter than completion; failing it does not mean every part of the answer was wrong.

Setup and original evidence

Qwen3.5 4B is the model I selected for the scheduled Home SOC report under the shared settings I tested. The work runs on the Minisforum using evidence from the Vault. Completion, expected explanations and the full answer checklist are separate measurements on those reporting tasks.

Family
Qwen3.5
Recorded size
4B

Minisforum MS-S1 MAX · Ollama 0.35.1 · CPU · Native structured profile

Context window: 4,096 tokens for input and output together. CPU-thread setting: 2; this is a runtime setting, not the host's core count.

Installed artifact digest: d8b0f5e9760cd1682034f292d7ef72ec46f432149be0df7574bf2d6e92e38c04

Methods and supporting files

  • Expanded outcomes

    Native, simulation and common-profile phases, including written defects and withheld responses.

    MODEL_COMPARISON_EXPANDED_RESULTS.md
  • Offline verification

    Request hashes, frozen manifests and the boundaries of mechanical verification.

    MODEL_STUDY_VERIFICATION.md
Home SOC: Four Models with Default Sampling →

Qwen3.5 4B

Written report; default sampling

Partial result

Measured on Minisforum MS-S1 MAX · CPU

Finished reports
8 of 12
6 summaries with alerts, each asked twice. Only naturally finished answers count here. (answers)
Stopped at the output cap
4 of 12
These answers returned text but reached the 700-token output limit before finishing. None of the written requests exceeded its 300-second deadline. (answers)
Finished answers with a major factual error
2 of 8
One task produced a major factual error, repeated in both answers. Repeating it twice is not two different incidents. (answers)

The model claimed 14 groups where the supplied summary contained 16. That error repeated twice; unfinished answers were withheld.

Setup and original evidence

Qwen3.5 4B is the model I selected for the scheduled Home SOC report under the shared settings I tested. The work runs on the Minisforum using evidence from the Vault. Completion, expected explanations and the full answer checklist are separate measurements on those reporting tasks.

Family
Qwen3.5
Recorded size
4B

Minisforum MS-S1 MAX · Ollama 0.35.1 · CPU · Native written profile

Context window: 4,096 tokens for input and output together. CPU-thread setting: 2; this is a runtime setting, not the host's core count.

Installed artifact digest: d8b0f5e9760cd1682034f292d7ef72ec46f432149be0df7574bf2d6e92e38c04

Methods and supporting files

  • Expanded outcomes

    Native, simulation and common-profile phases, including written defects and withheld responses.

    MODEL_COMPARISON_EXPANDED_RESULTS.md
  • Offline verification

    Request hashes, frozen manifests and the boundaries of mechanical verification.

    MODEL_STUDY_VERIFICATION.md
Home SOC: Four Models with Default Sampling →

Qwen3.5 9B

Structured report; default sampling

Partial result

Measured on Minisforum MS-S1 MAX · CPU

Finished reports
30 of 36
12 fixed log summaries, each asked 3 times. A finished report completed within 120 seconds and passed the report validator. (answers)
Passed full answer checklist
3 of 30
10 summaries contain alerts, each asked 3 times. A pass needs a finished answer, expected explanations, valid list lengths, no repeated selections/citations and the required review priority. (answers)
Expected explanations selected
30 of 63
21 expected explanation items across those 10 summaries, repeated 3 times. This counts selected items, not whole answers or new discoveries. (selections)

6 requests exceeded the 120-second deadline. The full answer checklist is stricter than completion; failing it does not mean every part of the answer was wrong.

Setup and original evidence

Qwen3.5 9B has records from two different projects: fitting a larger model on the X1S and producing structured Home SOC reports on the Minisforum. Generation speed and completed report checks measure different things. Each test keeps its own workload, runtime and outcome.

Family
Qwen3.5
Recorded size
9B

Minisforum MS-S1 MAX · Ollama 0.35.1 · CPU · Native structured profile

Context window: 4,096 tokens for input and output together. CPU-thread setting: 2; this is a runtime setting, not the host's core count.

Installed artifact digest: 56671c2ab9385f9cfcb404638e32cd62d88e3501d44822208363c010179a3c90

Methods and supporting files

  • Expanded outcomes

    Native, simulation and common-profile phases, including written defects and withheld responses.

    MODEL_COMPARISON_EXPANDED_RESULTS.md
  • Offline verification

    Request hashes, frozen manifests and the boundaries of mechanical verification.

    MODEL_STUDY_VERIFICATION.md
Home SOC: Four Models with Default Sampling →

Qwen3.5 9B

Written report; default sampling

Failed run

Measured on Minisforum MS-S1 MAX · CPU

Finished reports
0 of 12
6 summaries with alerts, each asked twice. Only naturally finished answers count here. (answers)
Stopped at the output cap
12 of 12
These answers returned text but reached the 700-token output limit before finishing. None of the written requests exceeded its 300-second deadline. (answers)
Finished answers with a major factual error
Not assessed
No finished answer was available to assess. This is not zero errors or an accuracy pass. (answers)

All 12 written answers stopped at the output cap. Their partial text is retained, but there is no finished answer to grade for factual errors.

Setup and original evidence

Qwen3.5 9B has records from two different projects: fitting a larger model on the X1S and producing structured Home SOC reports on the Minisforum. Generation speed and completed report checks measure different things. Each test keeps its own workload, runtime and outcome.

Family
Qwen3.5
Recorded size
9B

Minisforum MS-S1 MAX · Ollama 0.35.1 · CPU · Native written profile

Context window: 4,096 tokens for input and output together. CPU-thread setting: 2; this is a runtime setting, not the host's core count.

Installed artifact digest: 56671c2ab9385f9cfcb404638e32cd62d88e3501d44822208363c010179a3c90

Methods and supporting files

  • Expanded outcomes

    Native, simulation and common-profile phases, including written defects and withheld responses.

    MODEL_COMPARISON_EXPANDED_RESULTS.md
  • Offline verification

    Request hashes, frozen manifests and the boundaries of mechanical verification.

    MODEL_STUDY_VERIFICATION.md
Home SOC: Four Models with Default Sampling →

Gemma 4 12B QAT

Structured report; default sampling

Partial result

Measured on Minisforum MS-S1 MAX · CPU

Finished reports
12 of 36
12 fixed log summaries, each asked 3 times. A finished report completed within 120 seconds and passed the report validator. (answers)
Passed full answer checklist
6 of 30
10 summaries contain alerts, each asked 3 times. A pass needs a finished answer, expected explanations, valid list lengths, no repeated selections/citations and the required review priority. (answers)
Expected explanations selected
6 of 63
21 expected explanation items across those 10 summaries, repeated 3 times. This counts selected items, not whole answers or new discoveries. (selections)

24 requests exceeded the 120-second deadline. The full answer checklist is stricter than completion; failing it does not mean every part of the answer was wrong.

Setup and original evidence

Gemma 4 12B QAT was the larger installed alternative in the Home SOC reporting tests. The records show its structured-answer checks, deadlines and unfinished responses, so you can inspect what happened on the actual briefs.

Family
Gemma 4
Recorded size
12B

Minisforum MS-S1 MAX · Ollama 0.35.1 · CPU · Native structured profile

Context window: 4,096 tokens for input and output together. CPU-thread setting: 2; this is a runtime setting, not the host's core count.

Installed artifact digest: 38044be4f923e5a55264ed7df4eaac2676651a905f735197c504045140c02bd3

Methods and supporting files

  • Expanded outcomes

    Native, simulation and common-profile phases, including written defects and withheld responses.

    MODEL_COMPARISON_EXPANDED_RESULTS.md
  • Offline verification

    Request hashes, frozen manifests and the boundaries of mechanical verification.

    MODEL_STUDY_VERIFICATION.md
Home SOC: Four Models with Default Sampling →

Gemma 4 12B QAT

Written report; default sampling

Partial result

Measured on Minisforum MS-S1 MAX · CPU

Finished reports
8 of 12
6 summaries with alerts, each asked twice. Only naturally finished answers count here. (answers)
Stopped at the output cap
4 of 12
These answers returned text but reached the 700-token output limit before finishing. None of the written requests exceeded its 300-second deadline. (answers)
Finished answers with a major factual error
2 of 8
One task produced a major factual error, repeated in both answers. Repeating it twice is not two different incidents. (answers)

The model claimed 14 allowed events where the supplied summary contained 15 and described traffic as routine/internal without enough evidence. That error repeated twice; unfinished answers were withheld.

Setup and original evidence

Gemma 4 12B QAT was the larger installed alternative in the Home SOC reporting tests. The records show its structured-answer checks, deadlines and unfinished responses, so you can inspect what happened on the actual briefs.

Family
Gemma 4
Recorded size
12B

Minisforum MS-S1 MAX · Ollama 0.35.1 · CPU · Native written profile

Context window: 4,096 tokens for input and output together. CPU-thread setting: 2; this is a runtime setting, not the host's core count.

Installed artifact digest: 38044be4f923e5a55264ed7df4eaac2676651a905f735197c504045140c02bd3

Methods and supporting files

  • Expanded outcomes

    Native, simulation and common-profile phases, including written defects and withheld responses.

    MODEL_COMPARISON_EXPANDED_RESULTS.md
  • Offline verification

    Request hashes, frozen manifests and the boundaries of mechanical verification.

    MODEL_STUDY_VERIFICATION.md
Home SOC: Four Models with Default Sampling →

Home SOC: Models Reading Simulation Logs

I converted the simulation logs into summaries, then asked each model to review them twice. Some simulations produced no alerts, so completion across all requests is shown separately from explanations on the summaries that contain alerts.

21 source cases produced 9 different summaries: 8 with alerts and 1 empty summary shared by 13 sources. Each model made 42 requests, but only 16 were the alert-bearing tasks (8 summaries, twice). Those repeats and duplicate empty inputs do not represent 42 different incidents.

Qwen3 4B Instruct

Simulation logs; default sampling

Partial result

Measured on Minisforum MS-S1 MAX · CPU

Finished reports
42 of 42
21 source cases, each asked twice. 13 sources produced the same empty summary, so this total includes duplicate inputs. (answers)
All expected explanations shown
16 of 16
8 different summaries contain alerts, each asked twice. An answer counts only when every expected explanation is visible in the rendered report. (answers)
Passed full answer checklist
6 of 16
The same 16 alert-bearing attempts. The unedited answer must meet explanation, list-length, repetition and review-priority checks as well as finish. (answers)

Completion across all requests includes the empty summaries. Read the explanation and checklist counts for the 16 attempts with alerts. Identical repeated answers reused their source-linked agent review after exact identity checks.

Setup and original evidence

This is the instruction-tuned 4B Qwen3 entry. It appears in the X1S inference tests and the Home SOC reporting work on the Minisforum. The model name connects those records, while the file, hardware and settings on each row tell you which configuration actually ran.

Family
Qwen3
Recorded size
4B

Minisforum MS-S1 MAX · Ollama 0.35.1 · CPU · Native simulation-source profile

Context window: 4,096 tokens for input and output together. CPU-thread setting: 2; this is a runtime setting, not the host's core count.

Installed artifact digest: 0edcdef34593eac1aa2be9c7d06c432dcf81945adca5eca2f27662c18f168ba0

Methods and supporting files

  • Simulation-source results

    Distinct inputs, duplicate empty briefs, repeated assessments and complete outcomes.

    MODEL_COMPARISON_EXPANDED_RESULTS.md
  • Simulation method

    Virtual lab, offline engine replay and physical inline test boundaries.

    SIMULATED_ACCEPTANCE_2026-10-05.md
Home SOC: Models Reading Simulation Logs →

Qwen3.5 4B

Simulation logs; default sampling

Partial result

Measured on Minisforum MS-S1 MAX · CPU

Finished reports
42 of 42
21 source cases, each asked twice. 13 sources produced the same empty summary, so this total includes duplicate inputs. (answers)
All expected explanations shown
4 of 16
8 different summaries contain alerts, each asked twice. An answer counts only when every expected explanation is visible in the rendered report. (answers)
Passed full answer checklist
4 of 16
The same 16 alert-bearing attempts. The unedited answer must meet explanation, list-length, repetition and review-priority checks as well as finish. (answers)

Completion across all requests includes the empty summaries. Read the explanation and checklist counts for the 16 attempts with alerts. Identical repeated answers reused their source-linked agent review after exact identity checks.

Setup and original evidence

Qwen3.5 4B is the model I selected for the scheduled Home SOC report under the shared settings I tested. The work runs on the Minisforum using evidence from the Vault. Completion, expected explanations and the full answer checklist are separate measurements on those reporting tasks.

Family
Qwen3.5
Recorded size
4B

Minisforum MS-S1 MAX · Ollama 0.35.1 · CPU · Native simulation-source profile

Context window: 4,096 tokens for input and output together. CPU-thread setting: 2; this is a runtime setting, not the host's core count.

Installed artifact digest: d8b0f5e9760cd1682034f292d7ef72ec46f432149be0df7574bf2d6e92e38c04

Methods and supporting files

  • Simulation-source results

    Distinct inputs, duplicate empty briefs, repeated assessments and complete outcomes.

    MODEL_COMPARISON_EXPANDED_RESULTS.md
  • Simulation method

    Virtual lab, offline engine replay and physical inline test boundaries.

    SIMULATED_ACCEPTANCE_2026-10-05.md
Home SOC: Models Reading Simulation Logs →

Qwen3.5 9B

Simulation logs; default sampling

Partial result

Measured on Minisforum MS-S1 MAX · CPU

Finished reports
42 of 42
21 source cases, each asked twice. 13 sources produced the same empty summary, so this total includes duplicate inputs. (answers)
All expected explanations shown
16 of 16
8 different summaries contain alerts, each asked twice. An answer counts only when every expected explanation is visible in the rendered report. (answers)
Passed full answer checklist
14 of 16
The same 16 alert-bearing attempts. The unedited answer must meet explanation, list-length, repetition and review-priority checks as well as finish. (answers)

Completion across all requests includes the empty summaries. Read the explanation and checklist counts for the 16 attempts with alerts. Identical repeated answers reused their source-linked agent review after exact identity checks.

Setup and original evidence

Qwen3.5 9B has records from two different projects: fitting a larger model on the X1S and producing structured Home SOC reports on the Minisforum. Generation speed and completed report checks measure different things. Each test keeps its own workload, runtime and outcome.

Family
Qwen3.5
Recorded size
9B

Minisforum MS-S1 MAX · Ollama 0.35.1 · CPU · Native simulation-source profile

Context window: 4,096 tokens for input and output together. CPU-thread setting: 2; this is a runtime setting, not the host's core count.

Installed artifact digest: 56671c2ab9385f9cfcb404638e32cd62d88e3501d44822208363c010179a3c90

Methods and supporting files

  • Simulation-source results

    Distinct inputs, duplicate empty briefs, repeated assessments and complete outcomes.

    MODEL_COMPARISON_EXPANDED_RESULTS.md
  • Simulation method

    Virtual lab, offline engine replay and physical inline test boundaries.

    SIMULATED_ACCEPTANCE_2026-10-05.md
Home SOC: Models Reading Simulation Logs →

Gemma 4 12B QAT

Simulation logs; default sampling

Partial result

Measured on Minisforum MS-S1 MAX · CPU

Finished reports
40 of 42
21 source cases, each asked twice. 13 sources produced the same empty summary, so this total includes duplicate inputs. (answers)
All expected explanations shown
14 of 16
8 different summaries contain alerts, each asked twice. An answer counts only when every expected explanation is visible in the rendered report. (answers)
Passed full answer checklist
14 of 16
The same 16 alert-bearing attempts. The unedited answer must meet explanation, list-length, repetition and review-priority checks as well as finish. (answers)

Completion across all requests includes the empty summaries. Read the explanation and checklist counts for the 16 attempts with alerts. Identical repeated answers reused their source-linked agent review after exact identity checks.

Setup and original evidence

Gemma 4 12B QAT was the larger installed alternative in the Home SOC reporting tests. The records show its structured-answer checks, deadlines and unfinished responses, so you can inspect what happened on the actual briefs.

Family
Gemma 4
Recorded size
12B

Minisforum MS-S1 MAX · Ollama 0.35.1 · CPU · Native simulation-source profile

Context window: 4,096 tokens for input and output together. CPU-thread setting: 2; this is a runtime setting, not the host's core count.

Installed artifact digest: 38044be4f923e5a55264ed7df4eaac2676651a905f735197c504045140c02bd3

Methods and supporting files

  • Simulation-source results

    Distinct inputs, duplicate empty briefs, repeated assessments and complete outcomes.

    MODEL_COMPARISON_EXPANDED_RESULTS.md
  • Simulation method

    Virtual lab, offline engine replay and physical inline test boundaries.

    SIMULATED_ACCEPTANCE_2026-10-05.md
Home SOC: Models Reading Simulation Logs →

Home SOC: Four Models with Shared Sampling

Each model answered the same 12 tasks once with the sampling settings made explicit. Read completion first, then check whether the alert explanations and full answer checklist passed.

10 of the 12 tasks contain alerts. Completion uses all 12; explanation and checklist results use those 10. The 21 expected explanations count individual items across the same 10 tasks. This pass supports a choice for the scheduled report under these settings, not a general intelligence ranking.

Qwen3 4B Instruct

Structured report; shared sampling

Partial result

Measured on Minisforum MS-S1 MAX · CPU

Finished reports
10 of 12
12 fixed summaries asked once; 2 have no alerts. A report must finish within 120 seconds and pass the report validator. (answers)
All expected explanations shown
2 of 10
10 of those summaries contain alerts. Each pass means all expected explanations appear in the rendered report. (answers)
Passed full answer checklist
0 of 10
The same 10 alert-bearing tasks. A pass also requires a finished answer, valid list lengths, no repeated selections/citations and the required review priority, before display cleanup. (answers)
Expected explanations selected
12 of 21
21 individual explanation items across the same 10 tasks. This is an item count, not 21 cases. (selections)

2 answers stopped at the output cap. Of the 10 tasks with alerts, 2 showed every expected explanation and 0 met the full answer checklist. The 12/21 count tracks individual explanation items within those same tasks.

Setup and original evidence

This is the instruction-tuned 4B Qwen3 entry. It appears in the X1S inference tests and the Home SOC reporting work on the Minisforum. The model name connects those records, while the file, hardware and settings on each row tell you which configuration actually ran.

Family
Qwen3
Recorded size
4B

Minisforum MS-S1 MAX · Ollama 0.35.1 · CPU · Explicit common profile

Context window: 4,096 tokens for input and output together. CPU-thread setting: 2; this is a runtime setting, not the host's core count.

Installed artifact digest: 0edcdef34593eac1aa2be9c7d06c432dcf81945adca5eca2f27662c18f168ba0

Methods and supporting files

  • Common-profile results

    Exact settings, denominators, artifact identities and the configuration decision.

    MODEL_COMPARISON_EXPANDED_RESULTS.md
  • Refinement method

    Controls and reasons for keeping the result separate from model-size rankings.

    MODEL_REFINEMENT_RESULTS.md
Home SOC: Four Models with Shared Sampling →

Qwen3.5 4B

Structured report; shared sampling

Partial result

Measured on Minisforum MS-S1 MAX · CPU

Finished reports
12 of 12
12 fixed summaries asked once; 2 have no alerts. A report must finish within 120 seconds and pass the report validator. (answers)
All expected explanations shown
7 of 10
10 of those summaries contain alerts. Each pass means all expected explanations appear in the rendered report. (answers)
Passed full answer checklist
4 of 10
The same 10 alert-bearing tasks. A pass also requires a finished answer, valid list lengths, no repeated selections/citations and the required review priority, before display cleanup. (answers)
Expected explanations selected
18 of 21
21 individual explanation items across the same 10 tasks. This is an item count, not 21 cases. (selections)

All 12 finished. Of the 10 tasks with alerts, 7 showed every expected explanation and 4 met the full answer checklist. The 18/21 count tracks individual explanation items within those same tasks.

Setup and original evidence

Qwen3.5 4B is the model I selected for the scheduled Home SOC report under the shared settings I tested. The work runs on the Minisforum using evidence from the Vault. Completion, expected explanations and the full answer checklist are separate measurements on those reporting tasks.

Family
Qwen3.5
Recorded size
4B

Minisforum MS-S1 MAX · Ollama 0.35.1 · CPU · Explicit common profile

Context window: 4,096 tokens for input and output together. CPU-thread setting: 2; this is a runtime setting, not the host's core count.

Installed artifact digest: d8b0f5e9760cd1682034f292d7ef72ec46f432149be0df7574bf2d6e92e38c04

Methods and supporting files

  • Common-profile results

    Exact settings, denominators, artifact identities and the configuration decision.

    MODEL_COMPARISON_EXPANDED_RESULTS.md
  • Refinement method

    Controls and reasons for keeping the result separate from model-size rankings.

    MODEL_REFINEMENT_RESULTS.md
Home SOC: Four Models with Shared Sampling →

Qwen3.5 9B

Structured report; shared sampling

Partial result

Measured on Minisforum MS-S1 MAX · CPU

Finished reports
9 of 12
12 fixed summaries asked once; 2 have no alerts. A report must finish within 120 seconds and pass the report validator. (answers)
All expected explanations shown
5 of 10
10 of those summaries contain alerts. Each pass means all expected explanations appear in the rendered report. (answers)
Passed full answer checklist
2 of 10
The same 10 alert-bearing tasks. A pass also requires a finished answer, valid list lengths, no repeated selections/citations and the required review priority, before display cleanup. (answers)
Expected explanations selected
9 of 21
21 individual explanation items across the same 10 tasks. This is an item count, not 21 cases. (selections)

3 requests timed out. Of the 10 tasks with alerts, 5 showed every expected explanation and 2 met the full answer checklist. The 9/21 count tracks individual explanation items within those same tasks.

Setup and original evidence

Qwen3.5 9B has records from two different projects: fitting a larger model on the X1S and producing structured Home SOC reports on the Minisforum. Generation speed and completed report checks measure different things. Each test keeps its own workload, runtime and outcome.

Family
Qwen3.5
Recorded size
9B

Minisforum MS-S1 MAX · Ollama 0.35.1 · CPU · Explicit common profile

Context window: 4,096 tokens for input and output together. CPU-thread setting: 2; this is a runtime setting, not the host's core count.

Installed artifact digest: 56671c2ab9385f9cfcb404638e32cd62d88e3501d44822208363c010179a3c90

Methods and supporting files

  • Common-profile results

    Exact settings, denominators, artifact identities and the configuration decision.

    MODEL_COMPARISON_EXPANDED_RESULTS.md
  • Refinement method

    Controls and reasons for keeping the result separate from model-size rankings.

    MODEL_REFINEMENT_RESULTS.md
Home SOC: Four Models with Shared Sampling →

Gemma 4 12B QAT

Structured report; shared sampling

Partial result

Measured on Minisforum MS-S1 MAX · CPU

Finished reports
4 of 12
12 fixed summaries asked once; 2 have no alerts. A report must finish within 120 seconds and pass the report validator. (answers)
All expected explanations shown
2 of 10
10 of those summaries contain alerts. Each pass means all expected explanations appear in the rendered report. (answers)
Passed full answer checklist
2 of 10
The same 10 alert-bearing tasks. A pass also requires a finished answer, valid list lengths, no repeated selections/citations and the required review priority, before display cleanup. (answers)
Expected explanations selected
2 of 21
21 individual explanation items across the same 10 tasks. This is an item count, not 21 cases. (selections)

8 requests timed out. Of the 10 tasks with alerts, 2 showed every expected explanation and 2 met the full answer checklist. The 2/21 count tracks individual explanation items within those same tasks.

Setup and original evidence

Gemma 4 12B QAT was the larger installed alternative in the Home SOC reporting tests. The records show its structured-answer checks, deadlines and unfinished responses, so you can inspect what happened on the actual briefs.

Family
Gemma 4
Recorded size
12B

Minisforum MS-S1 MAX · Ollama 0.35.1 · CPU · Explicit common profile

Context window: 4,096 tokens for input and output together. CPU-thread setting: 2; this is a runtime setting, not the host's core count.

Installed artifact digest: 38044be4f923e5a55264ed7df4eaac2676651a905f735197c504045140c02bd3

Methods and supporting files

  • Common-profile results

    Exact settings, denominators, artifact identities and the configuration decision.

    MODEL_COMPARISON_EXPANDED_RESULTS.md
  • Refinement method

    Controls and reasons for keeping the result separate from model-size rankings.

    MODEL_REFINEMENT_RESULTS.md
Home SOC: Four Models with Shared Sampling →

Home SOC: Investigation Failures and Input Fix

The original investigation answers failed. A revised task then exposed two prompts that were too long for the configured context. After fixing the instructions and ensuring the full input reached the model, I reran the same cases.

This is a correction history on 6 constructed cases, each tried in 3 conditions: evidence only, analyst assistance, and assistance with repetition grouping. That produces 18 measured answers, not 18 independent incidents. All 3 corrected conditions passed, so this test shows no accuracy advantage for assistance or grouping.

Qwen3.5 4B

Original V1 investigator

Failed run

Measured on Minisforum MS-S1 MAX · Recorded backend in request receipts

Answers passing evidence and decision checks
0 of 18
6 constructed measured cases × 3 conditions (answers)
Finished 9B reviews
0 of 24
18 measured plus 6 practice; all capped (answers)

Some answers copied real groups and then claimed there were no alerts; empty cases invented groups. Practice answers stayed outside the measured denominator.

Setup and original evidence

Qwen3.5 4B is the model I selected for the scheduled Home SOC report under the shared settings I tested. The work runs on the Minisforum using evidence from the Vault. Completion, expected explanations and the full answer checklist are separate measurements on those reporting tasks.

Family
Qwen3.5
Recorded size
4B

Minisforum MS-S1 MAX · Ollama 0.35.1 · Recorded backend in request receipts · Original V1 investigator

Context window: 4,096 tokens for input and output together.

Installed artifact digest: d8b0f5e9760cd1682034f292d7ef72ec46f432149be0df7574bf2d6e92e38c04

Methods and supporting files

  • Original failures

    Preserved incorrect decisions, hallucinated groups and capped reviews.

    AUTOMATED_INVESTIGATION_RESULTS_2026-10-06.md
  • Corrected results

    V5 truncation, V6 full-input proof and unreliable reviewer controls.

    AUTOMATED_INVESTIGATION_CORRECTED_RESULTS_2026-10-06.md
  • Correction protocol

    Complete instructions, bounded decision slots and input-truncation guard.

    INVESTIGATION_CONTRACT_CORRECTION_2026-10-06.md
Home SOC: Investigation Failures and Input Fix →

Qwen3.5 4B

Intermediate V5; invalid condition comparison

Failed run

Measured on Minisforum MS-S1 MAX · Recorded backend in request receipts

Recorded passes before the input fix
16 of 18
Exposed regression set; two expanded inputs were truncated (answers)
Largest original expanded input
5464 tokens
Truncated to 2050 under context 4096

Two inputs were cut from 5,107 and 5,464 tokens to 2,050. The grouped condition saw different actual evidence from the expanded conditions, so 16/18 cannot support a grouping advantage.

Setup and original evidence

Qwen3.5 4B is the model I selected for the scheduled Home SOC report under the shared settings I tested. The work runs on the Minisforum using evidence from the Vault. Completion, expected explanations and the full answer checklist are separate measurements on those reporting tasks.

Family
Qwen3.5
Recorded size
4B

Minisforum MS-S1 MAX · Ollama 0.35.1 · Recorded backend in request receipts · Intermediate V5; invalid condition comparison

Context window: 4,096 tokens for input and output together.

Installed artifact digest: d8b0f5e9760cd1682034f292d7ef72ec46f432149be0df7574bf2d6e92e38c04

Methods and supporting files

  • Original failures

    Preserved incorrect decisions, hallucinated groups and capped reviews.

    AUTOMATED_INVESTIGATION_RESULTS_2026-10-06.md
  • Corrected results

    V5 truncation, V6 full-input proof and unreliable reviewer controls.

    AUTOMATED_INVESTIGATION_CORRECTED_RESULTS_2026-10-06.md
  • Correction protocol

    Complete instructions, bounded decision slots and input-truncation guard.

    INVESTIGATION_CONTRACT_CORRECTION_2026-10-06.md
Home SOC: Investigation Failures and Input Fix →

Qwen3.5 4B

Corrected V6 condition A: evidence only

Partial result

Measured on Minisforum MS-S1 MAX · Recorded backend in request receipts

Answers passing evidence and decision checks
6 of 6
The same 6 constructed cases, asked once in this condition with complete model input. These cases were already used during development. (answers)

6/6 passed in each of the three conditions. The model answered these known cases correctly after the input fix; assistance and grouping did not score higher than evidence alone. No humans took this test.

Setup and original evidence

Qwen3.5 4B is the model I selected for the scheduled Home SOC report under the shared settings I tested. The work runs on the Minisforum using evidence from the Vault. Completion, expected explanations and the full answer checklist are separate measurements on those reporting tasks.

Family
Qwen3.5
Recorded size
4B

Minisforum MS-S1 MAX · Ollama 0.35.1 · Recorded backend in request receipts · Corrected V6 condition A: evidence only

Context window: 8,192 tokens for input and output together.

Installed artifact digest: d8b0f5e9760cd1682034f292d7ef72ec46f432149be0df7574bf2d6e92e38c04

Methods and supporting files

  • Original failures

    Preserved incorrect decisions, hallucinated groups and capped reviews.

    AUTOMATED_INVESTIGATION_RESULTS_2026-10-06.md
  • Corrected results

    V5 truncation, V6 full-input proof and unreliable reviewer controls.

    AUTOMATED_INVESTIGATION_CORRECTED_RESULTS_2026-10-06.md
  • Correction protocol

    Complete instructions, bounded decision slots and input-truncation guard.

    INVESTIGATION_CONTRACT_CORRECTION_2026-10-06.md
Home SOC: Investigation Failures and Input Fix →

Qwen3.5 4B

Corrected V6 condition B: analyst assistance

Partial result

Measured on Minisforum MS-S1 MAX · Recorded backend in request receipts

Answers passing evidence and decision checks
6 of 6
The same 6 constructed cases, asked once in this condition with complete model input. These cases were already used during development. (answers)

6/6 passed in each of the three conditions. The model answered these known cases correctly after the input fix; assistance and grouping did not score higher than evidence alone. No humans took this test.

Setup and original evidence

Qwen3.5 4B is the model I selected for the scheduled Home SOC report under the shared settings I tested. The work runs on the Minisforum using evidence from the Vault. Completion, expected explanations and the full answer checklist are separate measurements on those reporting tasks.

Family
Qwen3.5
Recorded size
4B

Minisforum MS-S1 MAX · Ollama 0.35.1 · Recorded backend in request receipts · Corrected V6 condition B: analyst assistance

Context window: 8,192 tokens for input and output together.

Installed artifact digest: d8b0f5e9760cd1682034f292d7ef72ec46f432149be0df7574bf2d6e92e38c04

Methods and supporting files

  • Original failures

    Preserved incorrect decisions, hallucinated groups and capped reviews.

    AUTOMATED_INVESTIGATION_RESULTS_2026-10-06.md
  • Corrected results

    V5 truncation, V6 full-input proof and unreliable reviewer controls.

    AUTOMATED_INVESTIGATION_CORRECTED_RESULTS_2026-10-06.md
  • Correction protocol

    Complete instructions, bounded decision slots and input-truncation guard.

    INVESTIGATION_CONTRACT_CORRECTION_2026-10-06.md
Home SOC: Investigation Failures and Input Fix →

Qwen3.5 4B

Corrected V6 condition C: assistance plus grouping

Partial result

Measured on Minisforum MS-S1 MAX · Recorded backend in request receipts

Answers passing evidence and decision checks
6 of 6
The same 6 constructed cases, asked once in this condition with complete model input. These cases were already used during development. (answers)

6/6 passed in each of the three conditions. The model answered these known cases correctly after the input fix; assistance and grouping did not score higher than evidence alone. No humans took this test.

Setup and original evidence

Qwen3.5 4B is the model I selected for the scheduled Home SOC report under the shared settings I tested. The work runs on the Minisforum using evidence from the Vault. Completion, expected explanations and the full answer checklist are separate measurements on those reporting tasks.

Family
Qwen3.5
Recorded size
4B

Minisforum MS-S1 MAX · Ollama 0.35.1 · Recorded backend in request receipts · Corrected V6 condition C: assistance plus grouping

Context window: 8,192 tokens for input and output together.

Installed artifact digest: d8b0f5e9760cd1682034f292d7ef72ec46f432149be0df7574bf2d6e92e38c04

Methods and supporting files

  • Original failures

    Preserved incorrect decisions, hallucinated groups and capped reviews.

    AUTOMATED_INVESTIGATION_RESULTS_2026-10-06.md
  • Corrected results

    V5 truncation, V6 full-input proof and unreliable reviewer controls.

    AUTOMATED_INVESTIGATION_CORRECTED_RESULTS_2026-10-06.md
  • Correction protocol

    Complete instructions, bounded decision slots and input-truncation guard.

    INVESTIGATION_CONTRACT_CORRECTION_2026-10-06.md
Home SOC: Investigation Failures and Input Fix →

Qwen3.5 9B

Corrected V6 reviewer controls

Failed run

Measured on Minisforum MS-S1 MAX · Recorded backend in request receipts

Wrong-answer checks passed
1 of 6
6 deliberately wrong answers. Only 1 review met every required defect check; the larger model was unreliable as a judge. (answers)
Reviews matching every answer-key category
18 of 24
24 reviews, including practice. 18 matched every independently defined answer-key category; this is separate from the 6 wrong-answer controls. (answers)

The larger reviewer missed defects and raised false alarms. Its agreement never overrides the source score.

Setup and original evidence

Qwen3.5 9B has records from two different projects: fitting a larger model on the X1S and producing structured Home SOC reports on the Minisforum. Generation speed and completed report checks measure different things. Each test keeps its own workload, runtime and outcome.

Family
Qwen3.5
Recorded size
9B

Minisforum MS-S1 MAX · Ollama 0.35.1 · Recorded backend in request receipts · Corrected V6 reviewer controls

Context window: 4,096 tokens for input and output together.

Installed artifact digest: 56671c2ab9385f9cfcb404638e32cd62d88e3501d44822208363c010179a3c90

Methods and supporting files

  • Original failures

    Preserved incorrect decisions, hallucinated groups and capped reviews.

    AUTOMATED_INVESTIGATION_RESULTS_2026-10-06.md
  • Corrected results

    V5 truncation, V6 full-input proof and unreliable reviewer controls.

    AUTOMATED_INVESTIGATION_CORRECTED_RESULTS_2026-10-06.md
  • Correction protocol

    Complete instructions, bounded decision slots and input-truncation guard.

    INVESTIGATION_CONTRACT_CORRECTION_2026-10-06.md
Home SOC: Investigation Failures and Input Fix →

Home SOC: One Report on the Radeon GPU

One live report ran on the Minisforum's Radeon 8060S. The runner confirmed all 33 model layers were offloaded, and the returned report passed the existing checker.

The 20.781 seconds is the total HTTP request duration for one report with 309 generated tokens. The input and answer length differ from the CPU study. Use this as evidence that GPU execution worked, not a CPU/GPU speed comparison.

Qwen3.5 4B

First live GPU acceptance

Partial result

Measured on Minisforum MS-S1 MAX · Vulkan / Radeon 8060S

HTTP report duration
20.781 seconds
One live request; includes more than token generation
Actual generated tokens
309 tokens
Returned request receipt
Offloaded layers
33 layers
Actual runner identified Radeon 8060S; 33 of 33 layers

The structured report passed validation, but some explanation remained generic. No matched speedup or generation-rate claim.

Setup and original evidence

Qwen3.5 4B is the model I selected for the scheduled Home SOC report under the shared settings I tested. The work runs on the Minisforum using evidence from the Vault. Completion, expected explanations and the full answer checklist are separate measurements on those reporting tasks.

Family
Qwen3.5
Recorded size
4B

Minisforum MS-S1 MAX · Ollama 0.35.1 · Vulkan / Radeon 8060S · First live GPU acceptance

Context window: 4,096 tokens for input and output together. CPU-thread setting: 2; this is a runtime setting, not the host's core count.

Installed artifact digest: d8b0f5e9760cd1682034f292d7ef72ec46f432149be0df7574bf2d6e92e38c04

Methods and supporting files

  • GPU deployment evidence

    Actual offload, deployment boundaries, live acceptance and host availability.

    SQLITE_GPU_AND_DEPLOYMENT_2026-10-06.md
Home SOC: One Report on the Radeon GPU →

Models in these tests

Start with a model to see what I used it for, which files and devices I tested, and where it completed or failed.

Qwen3 0.6B6 result rows · Youyeetoo X1S

Qwen3 0.6B is the smallest Qwen3 model in these tests. The 0.6B label describes its parameter count; Q4_K_M identifies the quantized file I ran. Its small size made it a useful starting point for testing CPU inference and Intel GPU offload on the X1S.

Family
Qwen3
Recorded size
0.6B

The smallest matched X1S model completed both CPU runtimes and all three explicit llama.cpp device modes.

Qwen3 1.7B6 result rows · Youyeetoo X1S

Qwen3 1.7B is the next step up from the 0.6B model in the matched X1S tests. I used the Q4_K_M file in both CPU servers, then ran the same model through the three llama.cpp device modes. The two groups answer different questions, so their results are listed separately.

Family
Qwen3
Recorded size
1.7B

This model completed the matched CPU comparison and the full CPU, mixed, and Vulkan mode test.

Qwen3 4B Instruct8 result rows · Youyeetoo X1S, Minisforum MS-S1 MAX

This is the instruction-tuned 4B Qwen3 entry. It appears in the X1S inference tests and the Home SOC reporting work on the Minisforum. The model name connects those records, while the file, hardware and settings on each row tell you which configuration actually ran.

Family
Qwen3
Recorded size
4B

The Q4_K_M file completed the matched CPU test, then reached an i915 reset timeout during full Vulkan.

Phi-4 Mini4 result rows · Youyeetoo X1S

Phi-4 Mini gave me a second model family for the matched CPU test. Both runtimes loaded the Q4_K_M file, so I could compare the same workload beyond the Qwen models. Its later Vulkan failure belongs to the GPU test, not the completed CPU comparison.

Family
Phi-4
Recorded size
Mini

Phi-4 Mini completed both matched CPU servers. Its full-Vulkan window coincided with an i915 GPU hang.

Qwen3 8B2 result rows · Youyeetoo X1S

The 8B Qwen3 entry was useful for testing the upper end of what I could run on the 16 GB X1S. Loading and completing a CPU request was one result; the larger full-Vulkan attempt was a separate test with its own failure record.

Family
Qwen3
Recorded size
8B

Qwen3 8B fit during the original CPU matrix at 0.924 tok/s. A later full-Vulkan attempt coincided with an i915 GPU hang.

Gemma 3 4B3 result rows · Youyeetoo X1S

The Gemma 3 entry includes a separate text-only derivative made from the original artifact. That distinction matters when reproducing the run: the derivative completed true CPU, while the later Vulkan attempt still hit the device-loss path. Keep the file identity with the result.

Family
Gemma 3
Recorded size
4B

A separate text-only derivative completed true CPU. The later Vulkan path ended with timeouts, an i915 reset, and device loss.

Ling-mini-2.02 result rows · Youyeetoo X1S

Ling-mini-2.0 is listed as 16B total parameters with 3B active. For this test I pinned one 8.8 GB IQ4_XS file, then changed the CPU thread count. The model page keeps the three- and four-thread settings, repetitions and thermal limits beside their results.

Family
Ling-mini
Recorded size
16B total / 3B active

The exact pinned IQ4_XS file completed true-CPU tests at three and four threads.

Qwen3.5 0.8B9 result rows · Youyeetoo X1S

This is Qwen3.5 0.8B, a different family and size from Qwen3 0.6B. I tested normal Ollama generation and paired MTP settings on the X1S. MTP uses a draft path to propose tokens; the off/on rows show what that extra work cost on the N5095.

Family
Qwen3.5
Recorded size
0.8B

Qwen3.5 0.8B produced the fastest normal text-generation result in the X1S work and completed every MTP depth pair.

Qwen3.5 2B9 result rows · Youyeetoo X1S

Qwen3.5 2B sits between the 0.8B and 9B entries in the X1S collection. It has a normal Ollama result and a separate MTP depth sweep, which lets you inspect how draft settings behaved at another model size.

Family
Qwen3.5
Recorded size
2B

Qwen3.5 2B completed the normal Ollama run and MTP depths one through four.

Qwen3.5 9B6 result rows · Youyeetoo X1S, Minisforum MS-S1 MAX

Qwen3.5 9B has records from two different projects: fitting a larger model on the X1S and producing structured Home SOC reports on the Minisforum. Generation speed and completed report checks measure different things. Each test keeps its own workload, runtime and outcome.

Family
Qwen3.5
Recorded size
9B

The official Q4_K_M Ollama artifact fit in 16 GB and averaged 1.110 tok/s across five prompts.

Gemma 4 E2B9 result rows · Youyeetoo X1S

Gemma 4 E2B used a separate assistant model for the X1S MTP tests. I kept the draft-path proof and off/on pairs because loading the main model alone would not establish that speculative decoding was active.

Family
Gemma 4
Recorded size
E2B

Gemma 4 E2B completed the normal Ollama run and a proven MTP sweep with its separate assistant model.

Gemma 4 E4B1 result rows · Youyeetoo X1S

This Gemma 4 E4B entry records the original warm Ollama run on the X1S. It is a useful reference when browsing that test, with its original method and status kept on the result row.

Family
Gemma 4
Recorded size
E4B

Gemma 4 E4B completed the original warm Ollama test at 1.78 tok/s.

BitCPM-CANN 1B2 result rows · Youyeetoo X1S

BitCPM-CANN 1B is recorded here as the official TQ2_0 GGUF. I gave the same verified file to llama.cpp and Ollama, and they did not have the same loading outcome. The useful question here is runtime compatibility before it is generation speed.

Family
BitCPM
Recorded size
1B

The exact official TQ2_0 GGUF ran in pinned llama.cpp and failed to load in Ollama 0.32.1.

Granite 4 Tiny-H1 result rows · Youyeetoo X1S

Granite 4 Tiny-H has one retained Ollama observation on the X1S. The result links back to that test rather than expanding a single measurement into a broader model comparison.

Family
Granite 4
Recorded size
Tiny-H

The X1S recorded one 5.43 tok/s Ollama observation.

LFM2.51 result rows · Youyeetoo X1S

This entry keeps the LFM2.5 label from the original Ollama run. It used a mutable latest tag, so the row preserves the dated observation and the artifact limitation together.

Family
LFM
Recorded size
2.5

The X1S recorded one 4.95 tok/s result from a mutable latest tag.

Gemma 3n E2B1 result rows · Youyeetoo X1S

Gemma 3n E2B is a separate entry from Gemma 4 E2B. Its X1S record comes from the original Ollama test, with that run linked directly below.

Family
Gemma 3n
Recorded size
E2B

The X1S recorded one 3.24 tok/s Ollama result.

DeepSeek-R1 Distill Qwen 1.5B2 result rows · Indiedroid Nova, Raspberry Pi 5

This is the DeepSeek-R1 model distilled into a Qwen 1.5B model, tested as W8A8 on the Nova NPU. I asked for the same state-capitals list used in the other Nova runs and retained what the answer actually did alongside its generation rate.

Family
DeepSeek-R1
Recorded size
1.5B

The Nova NPU run started at 11.5 tok/s, then the state-capitals answer degraded into invented cities.

Qwen 2.5 3B Instruct2 result rows · Indiedroid Nova, Raspberry Pi 5

Qwen 2.5 3B Instruct ran as a W8A8 model through RKLLM on the Nova. The recorded task was a state-capitals list, so this page keeps both the generation rate and the observed answer result instead of treating throughput as answer quality.

Family
Qwen 2.5
Recorded size
3B

The Nova NPU result reached 7.0 tok/s and returned all 50 state capitals correctly.

Llama 3.1 8B Instruct2 result rows · Indiedroid Nova, Raspberry Pi 5

Llama 3.1 8B Instruct connects the Nova NPU run with the Pi 5 references from the original article. The Nova measurement is mine; the Pi rows are outside references with their own sources and test conditions.

Family
Llama 3.1
Recorded size
8B

The Nova NPU measured 3.72 tok/s. A separate 1.99 tok/s Pi 5 value remains labeled as an outside reference.

Qwen3.5 4B10 result rows · Minisforum MS-S1 MAX

Qwen3.5 4B is the model I selected for the scheduled Home SOC report under the shared settings I tested. The work runs on the Minisforum using evidence from the Vault. Completion, expected explanations and the full answer checklist are separate measurements on those reporting tasks.

Family
Qwen3.5
Recorded size
4B

I selected Qwen3.5 4B for the scheduled Home SOC report under the tested shared settings. Finishing a report, including the expected explanations and passing the full answer checklist are counted separately.

Gemma 4 12B QAT4 result rows · Minisforum MS-S1 MAX

Gemma 4 12B QAT was the larger installed alternative in the Home SOC reporting tests. The records show its structured-answer checks, deadlines and unfinished responses, so you can inspect what happened on the actual briefs.

Family
Gemma 4
Recorded size
12B

Gemma 4 12B QAT was the larger alternative in the Home SOC tests. Its timeouts, unfinished answers and incorrect counts remain in the results.

Model and file

A model name identifies the model. A variant such as Q4_K_M or IQ4_XS identifies the quantization used for a particular file. The artifact hash ties a result to the exact bytes I tested.

Runtime and backend

Ollama and llama.cpp run the model. CPU, Vulkan and RKLLM NPU paths describe where or how the computation ran. A successful CPU request and a failed GPU request can belong to the same model.

Generation and prompt processing

Generation measures output tokens per second. Prompt processing measures how quickly the input was processed. Open the test group for the workload, token counts and timing method behind each rate.

Context and report checks

The context window holds input and output together. In the Home SOC tests, completed reports, expected explanations and full answer checks have separate counts and denominators. Read the label beside each value.

Runs and methods

Browse by test group

Published result2026-08-31

Matched Ollama and llama.cpp CPU Test

Four exact Q4_K_M GGUFs received the same raw prompt, context, thread count, batch settings, sampler, and 96-token output through Ollama 0.32.1 and native llama.cpp commit 9a286ac.

8 records
Open full test
Published result2026-08-31

True CPU, Mixed Host Operations, and Full Vulkan

Qwen3 0.6B and 1.7B ran in three explicit modes with the same native binary and pp128/tg96 workload. Larger full-Vulkan models were retained as failure evidence.

10 records4 rows labeled failed
Open full test
Published result2026-08-31

Ling-mini-2.0 IQ4_XS CPU Thread Test

The exact 8.8 GB Bartowski IQ4_XS file from pinned revision 8be84a0 was verified before testing at three and four CPU threads.

2 records
Open full test
Published result2026-08-31

Ollama MTP Depth Sweep on the N5095

Qwen3.5 0.8B, Qwen3.5 2B, and Gemma 4 E2B ran with MTP off and on at every draft depth from one through four. Service logs proved the draft path was active.

24 records
Open full test
Published result2026-08-31

Additional Model Results on the X1S

Eight additional models were recorded with their actual averaging method, package peak, and artifact limitation where one applied.

8 records
Open full test
Published result2026-08-31

BitCPM and Gemma Runtime Compatibility

The exact BitCPM TQ2_0 file exposed a runtime-support difference. A separate Gemma 3 text-only derivative documented a different conversion problem before the later Vulkan failure.

3 records1 rows labeled failed
Open full test
Published result2026-08-23

Original X1S CPU-Only Model Matrix

Six Ollama models received the same deterministic prompt with one cold and two warm requests during the original Kali and hardware test.

6 records
Open full test
Published result2026-04-10

Indiedroid Nova RKLLM NPU Test

Three W8A8 RKLLM models ran on the RK3588S NPU with NPU utilization and memory monitored over SSH.

3 records
Open full test
External reference2026-04-10

Raspberry Pi 5 Published Reference Rows

The values quoted in the Nova article remain ranges or cited results. They are kept separate from Trevor-measured rows and are not converted into invented exact midpoints.

3 records
Open full test
Published result2026-10-05

Protectli V1610: Detection, Inline Block and Rollback

I followed a harmless request from my Windows client into Suricata, changed only its test signature to drop, and then restored it to alert. HTTPS and DNS controls checked that ordinary traffic still worked while the selected request was blocked.

6 records
Open full test
Published result2026-10-05

Protectli V1610: Isolated PF Packet Checks

I used three temporary FreeBSD VNET stacks on the Vault to check a small PF policy with real packets, captures and counters. The eight cases cover allowed controls, NAT, unsolicited WAN traffic, spoofing and finite bursts.

8 records
Open full test
Published result2026-10-05

Protectli V1610: Suricata Regression and Policy Replays

I kept engine regressions separate from replays of the installed policy. That distinction matters here: the upstream regression cases passed, while the installed rules produced zero alerts on 20 unchanged upstream captures.

5 records
Open full test
Published result2026-10-05

Protectli V1610: Routed Download Observations

I measured short, certificate-validated downloads through the final IDS and IPS configurations using the same fixed endpoint. The individual trials stay here alongside their medians because the Internet path varied between requests.

2 records
Open full test
Published result2026-10-05

Protectli V1610: LAN Endpoint and Capture Counters

I also transferred fixed payloads from a bounded server on the Vault to the owned LAN client, then retained the engine counters with their actual observation windows. Successful downloads and complete packet inspection are different measurements here.

3 records
Open full test
Completed bounded thermal check2026-10-05

Protectli V1610: Bounded CPU Thermal Check

Four owned CPU-load processes completed the 180-second check with five-second core-temperature sampling. The peak was 62 °C, followed by recorded cooling and process cleanup.

1 records
Open full test
Published result2026-10-14

Home SOC: Evidence Collection, Retention and Recovery

The firewall records also need to survive review and a restart. These checks cover Vault event forwarding, the Windows evidence tools, rolling storage and recovery after sign-in, with the maintenance gaps and failed readings kept in the record.

7 records
Open full test
Partial result2026-10-06

Home SOC: Four Models with Default Sampling

Four models answered the same saved log summaries. This group contains two tasks: structured reports with a two-minute deadline, and written reports with a five-minute deadline. The sampling settings use each model's defaults.

8 records1 rows labeled failed
Open full test
Partial result2026-10-06

Home SOC: Models Reading Simulation Logs

I converted the simulation logs into summaries, then asked each model to review them twice. Some simulations produced no alerts, so completion across all requests is shown separately from explanations on the summaries that contain alerts.

4 records
Open full test
Partial result2026-10-06

Home SOC: Four Models with Shared Sampling

Each model answered the same 12 tasks once with the sampling settings made explicit. Read completion first, then check whether the alert explanations and full answer checklist passed.

4 records
Open full test
Partial result2026-10-06

Home SOC: Investigation Failures and Input Fix

The original investigation answers failed. A revised task then exposed two prompts that were too long for the configured context. After fixing the instructions and ensuring the full input reached the model, I reran the same cases.

6 records3 rows labeled failed
Open full test
Partial result2026-10-06

Home SOC: One Report on the Radeon GPU

One live report ran on the Minisforum's Radeon 8060S. The runner confirmed all 33 model layers were offloaded, and the returned report passed the existing checker.

1 records
Open full test

Device record

Youyeetoo X1S

The X1S has the deepest result set here: matched Ollama and llama.cpp CPU requests, explicit CPU and Vulkan modes, thermal data, MTP tests, compatibility failures, and retained i915 evidence.

View device

Device record

Indiedroid Nova

Three W8A8 models ran through the RK3588S NPU. The result set includes speed and the observed answer-quality outcome from the shared state-capitals prompt.

View device

Device record

Raspberry Pi 5

The Pi 5 entries are external references, not Trevor’s matched rerun. They stay visible because they explain the original Nova comparison, but they do not belong on a controlled cross-device leaderboard.

View device

Device record

Protectli V1610

These are the firewall and evidence-workflow checks from my V1610 Home SOC build: physical detection, inline blocking and rollback, isolated PF tests, Suricata replays, path measurements, temperature, retention and restart recovery. The local models run on the Minisforum, where their results are listed separately.

View device

Device record

Minisforum MS-S1 MAX

These are Home SOC tests run on the MS-S1 MAX: comparing four local models, checking investigation answers and confirming Radeon 8060S offload. The Vault supplies the firewall events. These entries do not report results from the separate MS-S1 knowledge-assistant or fine-tuning project.

View device

Get an email when I publish new hardware reviews, benchmarks, and security research. Unsubscribe anytime.

Email goes to Buttondown. Privacy details.

© 2026 Trevor Unland. All rights reserved.

PrivacyTermsRSS Feed

$ echo "Built with React + TypeScript"