Qwen 2.5 · 3B
The Nova NPU result reached 7.0 tok/s and returned all 50 state capitals correctly.
The Nova NPU result reached 7.0 tok/s and returned all 50 state capitals correctly.
It was slower than the smaller DeepSeek row but produced the useful answer on the shared prompt.
The rows on this page use W8A8 RKLLM and Q4 reference through RKLLM 1.2.1 and llama.cpp. They describe those exact artifacts and runs, not every version that shares the model name.
The fastest retained generation row is 7 tok/s through RKLLM 1.2.1 using NPU in 50 state-capitals prompt mode. Returned all 50 state capitals correctly.
1 row is an outside reference, kept separate from Trevor-measured results.
The rows below can come from different prompts and methods. Open the full test before treating two numbers as a direct comparison.
| Model and artifact | Runtime and mode | Generation | Prompt | Peak | State | Full test |
|---|---|---|---|---|---|---|
| Qwen 2.5 3B Instruct W8A8 RKLLM | RKLLM 1.2.1 NPU · 50 state-capitals prompt | 7 tok/s | n/a | n/a | Published result | Nova NPU models |
Open result detailsWhy this model is hereThe Nova NPU result reached 7.0 tok/s and returned all 50 state capitals correctly. It was slower than the smaller DeepSeek row but produced the useful answer on the shared prompt. What ranW8A8 RKLLM ran through RKLLM 1.2.1 using NPU in 50 state-capitals prompt mode on Indiedroid Nova. Returned all 50 state capitals correctly. Recorded setupThe full test page contains the shared controls and comparison boundary for this row. | ||||||
| Qwen 2.5 3B Instruct Q4 reference | llama.cpp CPU · Published reference range | about 4 to 5 tok/s | n/a | n/a | External reference | Pi 5 references |
Open result detailsWhy this model is hereThe Nova NPU result reached 7.0 tok/s and returned all 50 state capitals correctly. It was slower than the smaller DeepSeek row but produced the useful answer on the shared prompt. What ranQ4 reference ran through llama.cpp using CPU in Published reference range mode on Raspberry Pi 5. Approximate published range. Not Trevor-measured. Recorded setupThe full test page contains the shared controls and comparison boundary for this row. | ||||||
2026-04-10
The three Nova rows share the local test. Raspberry Pi numbers in the article came from outside references with different runtime and quantization.
Open full test2026-04-10
These are external references with different runtime, quantization, and hardware approach. A matched Trevor-run Pi 5 test has not been completed.
Open full test