The Pi 5 entries are external references, not Trevor’s matched rerun. They stay visible because they explain the original Nova comparison, but they do not belong on a controlled cross-device leaderboard.
External references cited in the Nova article.
The values quoted in the Nova article remain ranges or cited results. They are kept separate from Trevor-measured rows and are not converted into invented exact midpoints.
Open full testEvery retained row
| Model and artifact | Runtime and mode | Generation | Prompt | Peak | State | Full test |
|---|---|---|---|---|---|---|
| DeepSeek-R1 Distill Qwen 1.5B Q4 reference | llama.cpp CPU · Published reference range | about 6 to 8 tok/s | n/a | n/a | External reference | Pi 5 references |
Open result detailsWhy this model is hereThe Nova NPU run started at 11.5 tok/s, then the state-capitals answer degraded into invented cities. It is the clearest example in the Hub of why throughput and useful output cannot be treated as the same result. What ranQ4 reference ran through llama.cpp using CPU in Published reference range mode on Raspberry Pi 5. Approximate published range. Not Trevor-measured. Recorded setupThe full test page contains the shared controls and comparison boundary for this row. | ||||||
| Qwen 2.5 3B Instruct Q4 reference | llama.cpp CPU · Published reference range | about 4 to 5 tok/s | n/a | n/a | External reference | Pi 5 references |
Open result detailsWhy this model is hereThe Nova NPU result reached 7.0 tok/s and returned all 50 state capitals correctly. It was slower than the smaller DeepSeek row but produced the useful answer on the shared prompt. What ranQ4 reference ran through llama.cpp using CPU in Published reference range mode on Raspberry Pi 5. Approximate published range. Not Trevor-measured. Recorded setupThe full test page contains the shared controls and comparison boundary for this row. | ||||||
| Llama 3.1 8B Instruct Q4 reference | llama.cpp CPU · Jeff Geerling published result | 1.99 tok/s | n/a | n/a | External reference | Pi 5 references |
Open result detailsWhy this model is hereThe Nova NPU measured 3.72 tok/s. A separate 1.99 tok/s Pi 5 value remains labeled as an outside reference. It connects Trevor-measured Nova data with a clearly separated published Pi reference without presenting the two methods as a matched hardware contest. What ranQ4 reference ran through llama.cpp using CPU in Jeff Geerling published result mode on Raspberry Pi 5. Cited result. Not Trevor-measured. Recorded setupThe full test page contains the shared controls and comparison boundary for this row. | ||||||