BitCPM · 1B
The exact official TQ2_0 GGUF ran in pinned llama.cpp and failed to load in Ollama 0.32.1.
The exact official TQ2_0 GGUF ran in pinned llama.cpp and failed to load in Ollama 0.32.1.
This is a runtime-support result, not a speed contest. The same verified file produced inference in one runtime and a tensor-size overflow in the other.
The rows on this page use Official TQ2_0 GGUF through llama.cpp 9a286ac and Ollama 0.32.1. They describe those exact artifacts and runs, not every version that shares the model name.
The fastest retained generation row is 8.584 tok/s through llama.cpp 9a286ac using CPU in True CPU, five repetitions mode. Pinned llama.cpp accepted the verified file and completed the controlled true-CPU workload.
1 retained row is a failure: Ollama rejected the same verified file with a tensor-size overflow before inference.
The rows below can come from different prompts and methods. Open the full test before treating two numbers as a direct comparison.
| Model and artifact | Runtime and mode | Generation | Prompt | Peak | State | Full test |
|---|---|---|---|---|---|---|
| BitCPM-CANN 1B Official TQ2_0 GGUF | llama.cpp 9a286ac CPU · True CPU, five repetitions | 8.584 tok/s | 13.01 tok/s | 76 °C | Published result | Runtime compatibility |
Open result detailsWhy this model is hereThe exact official TQ2_0 GGUF ran in pinned llama.cpp and failed to load in Ollama 0.32.1. This is a runtime-support result, not a speed contest. The same verified file produced inference in one runtime and a tensor-size overflow in the other. What ranOfficial TQ2_0 GGUF ran through llama.cpp 9a286ac using CPU in True CPU, five repetitions mode on Youyeetoo X1S. Pinned llama.cpp accepted the verified file and completed the controlled true-CPU workload. Recorded setup
Artifact SHA-256 | ||||||
| BitCPM-CANN 1B Official TQ2_0 GGUF | Ollama 0.32.1 CPU · Model load | n/a | n/a | n/a | Failed run | Runtime compatibility |
Open result detailsWhy this model is hereThe exact official TQ2_0 GGUF ran in pinned llama.cpp and failed to load in Ollama 0.32.1. This is a runtime-support result, not a speed contest. The same verified file produced inference in one runtime and a tensor-size overflow in the other. What ranOfficial TQ2_0 GGUF ran through Ollama 0.32.1 using CPU in Model load mode on Youyeetoo X1S. Ollama rejected the same verified file with a tensor-size overflow before inference. Recorded setupThe full test page contains the shared controls and comparison boundary for this row. Artifact SHA-256 | ||||||
2026-08-31
BitCPM is not a matched runtime speed contest because Ollama never loaded the model. The Gemma derivative is inspectable but does not repair the Vulkan device-loss path.
Open full test