DeepSeek-R1 · 1.5B
The Nova NPU run started at 11.5 tok/s, then the state-capitals answer degraded into invented cities.
The Nova NPU run started at 11.5 tok/s, then the state-capitals answer degraded into invented cities.
It is the clearest example in the Hub of why throughput and useful output cannot be treated as the same result.
The rows on this page use W8A8 RKLLM and Q4 reference through RKLLM 1.2.1 and llama.cpp. They describe those exact artifacts and runs, not every version that shares the model name.
The fastest retained generation row is 11.5 tok/s through RKLLM 1.2.1 using NPU in 50 state-capitals prompt mode. Started fast, then invented cities around state seven.
1 row is an outside reference, kept separate from Trevor-measured results.
The rows below can come from different prompts and methods. Open the full test before treating two numbers as a direct comparison.
| Model and artifact | Runtime and mode | Generation | Prompt | Peak | State | Full test |
|---|---|---|---|---|---|---|
| DeepSeek-R1 Distill Qwen 1.5B W8A8 RKLLM | RKLLM 1.2.1 NPU · 50 state-capitals prompt | 11.5 tok/s | n/a | n/a | Published result | Nova NPU models |
Open result detailsWhy this model is hereThe Nova NPU run started at 11.5 tok/s, then the state-capitals answer degraded into invented cities. It is the clearest example in the Hub of why throughput and useful output cannot be treated as the same result. What ranW8A8 RKLLM ran through RKLLM 1.2.1 using NPU in 50 state-capitals prompt mode on Indiedroid Nova. Started fast, then invented cities around state seven. Recorded setupThe full test page contains the shared controls and comparison boundary for this row. | ||||||
| DeepSeek-R1 Distill Qwen 1.5B Q4 reference | llama.cpp CPU · Published reference range | about 6 to 8 tok/s | n/a | n/a | External reference | Pi 5 references |
Open result detailsWhy this model is hereThe Nova NPU run started at 11.5 tok/s, then the state-capitals answer degraded into invented cities. It is the clearest example in the Hub of why throughput and useful output cannot be treated as the same result. What ranQ4 reference ran through llama.cpp using CPU in Published reference range mode on Raspberry Pi 5. Approximate published range. Not Trevor-measured. Recorded setupThe full test page contains the shared controls and comparison boundary for this row. | ||||||
2026-04-10
The three Nova rows share the local test. Raspberry Pi numbers in the article came from outside references with different runtime and quantization.
Open full test2026-04-10
These are external references with different runtime, quantization, and hardware approach. A matched Trevor-run Pi 5 test has not been completed.
Open full test