Can Ternary Bonsai 4B run on ROG Phone 9 Pro?
What this means
Our estimate says Ternary Bonsai 4B should fit comfortably on your ROG Phone 9 Pro.
Download the Q2_0 version, which is about 1.1 GB. We expect it to use about 2 GB of the roughly 20 GB available to a model on this phone.
At the estimated speed, a roughly 300-word answer may take about 13 seconds to finish.
This result is calculated from the phone and model specifications. It has not been measured on this exact phone and setup.
See how fast it feels
Estimated at 31.4 tokens/s — instant. A ~300-word reply takes about 13 seconds on this phone.
Where the memory goes
| Component | Detail | GB |
|---|---|---|
| Model weights | Q2_0 GGUF (1.1 GB) + mmap overhead | 1.2 |
| KV cache | 4K context window | 0.3 |
| Runtime | llama.cpp + app overhead | 0.6 |
| Total needed | at Q2_0, 4K context | 2 |
| Working budget | 24 GB RAM − Android system reserve | 20 |
| Headroom | remaining inside the working budget | 18 |
Pick your quant
| Quant | Download | Verdict | Speed |
|---|---|---|---|
| Q2_0 BEST HERE | 1.1 GB | ✓ Runs great | ~31.4 tokens/s |
| Q2_0_g64 | 1.1 GB | ✓ Runs great | ~31.4 tokens/s |
Use the supported phone path
The current App Store and Play Store versions of PocketPal cannot load this tracked ternary file. Memory fit does not make this exact download beginner-ready.
For the same kind of chat in PocketPal, use this supported build instead:
Check Bonsai 27B (1-bit)