Indiedroid Nova RKLLM NPU Test
Three W8A8 RKLLM models ran on the RK3588S NPU with NPU utilization and memory monitored over SSH.
Open full testThree W8A8 models ran through the RK3588S NPU. The result set includes speed and the observed answer-quality outcome from the shared state-capitals prompt.
Measured on Trevor’s Indiedroid Nova.
Three W8A8 RKLLM models ran on the RK3588S NPU with NPU utilization and memory monitored over SSH.
Open full testEvery retained row
| Model and artifact | Runtime and mode | Generation | Prompt | Peak | State | Full test |
|---|---|---|---|---|---|---|
| DeepSeek-R1 Distill Qwen 1.5B W8A8 RKLLM | RKLLM 1.2.1 NPU · 50 state-capitals prompt | 11.5 tok/s | n/a | n/a | Published result | Nova NPU models |
Open result detailsWhy this model is hereThe Nova NPU run started at 11.5 tok/s, then the state-capitals answer degraded into invented cities. It is the clearest example in the Hub of why throughput and useful output cannot be treated as the same result. What ranW8A8 RKLLM ran through RKLLM 1.2.1 using NPU in 50 state-capitals prompt mode on Indiedroid Nova. Started fast, then invented cities around state seven. Recorded setupThe full test page contains the shared controls and comparison boundary for this row. | ||||||
| Qwen 2.5 3B Instruct W8A8 RKLLM | RKLLM 1.2.1 NPU · 50 state-capitals prompt | 7 tok/s | n/a | n/a | Published result | Nova NPU models |
Open result detailsWhy this model is hereThe Nova NPU result reached 7.0 tok/s and returned all 50 state capitals correctly. It was slower than the smaller DeepSeek row but produced the useful answer on the shared prompt. What ranW8A8 RKLLM ran through RKLLM 1.2.1 using NPU in 50 state-capitals prompt mode on Indiedroid Nova. Returned all 50 state capitals correctly. Recorded setupThe full test page contains the shared controls and comparison boundary for this row. | ||||||
| Llama 3.1 8B Instruct W8A8 RKLLM | RKLLM 1.2.1 NPU · 50 state-capitals prompt | 3.72 tok/s | n/a | n/a | Published result | Nova NPU models |
Open result detailsWhy this model is hereThe Nova NPU measured 3.72 tok/s. A separate 1.99 tok/s Pi 5 value remains labeled as an outside reference. It connects Trevor-measured Nova data with a clearly separated published Pi reference without presenting the two methods as a matched hardware contest. What ranW8A8 RKLLM ran through RKLLM 1.2.1 using NPU in 50 state-capitals prompt mode on Indiedroid Nova. Measured Nova NPU result. Recorded setupThe full test page contains the shared controls and comparison boundary for this row. | ||||||