Can Ternary Bonsai 8B run on iPhone 17 Pro?
What this means
Our estimate says Ternary Bonsai 8B should fit comfortably on your iPhone 17 Pro.
Download the Q2_0 version, which is about 2.2 GB. We expect it to use about 3.5 GB of the roughly 7.8 GB available to a model on this phone.
At the estimated speed, a roughly 300-word answer may take about 25 seconds to finish.
This result is calculated from the phone and model specifications. It has not been measured on this exact phone and setup.
See how fast it feels
Estimated at 15.7 tokens/s — instant. A ~300-word reply takes about 25 seconds on this phone.
Where the memory goes
| Component | Detail | GB |
|---|---|---|
| Model weights | Q2_0 GGUF (2.2 GB) + mmap overhead | 2.3 |
| KV cache | 4K context window | 0.6 |
| Runtime | llama.cpp + app overhead | 0.6 |
| Total needed | at Q2_0, 4K context | 3.5 |
| Working budget | 12 GB RAM − iOS reserve (jetsam limit) | 7.8 |
| Headroom | remaining inside the working budget | 4.3 |
Pick your quant
| Quant | Download | Verdict | Speed |
|---|---|---|---|
| Q2_0 BEST HERE | 2.2 GB | ✓ Runs great | ~15.7 tokens/s |
| Q2_0_g64 | 2.3 GB | ✓ Runs great | ~15 tokens/s |
Use the supported phone path
The current App Store and Play Store versions of PocketPal cannot load this tracked ternary file. Memory fit does not make this exact download beginner-ready.
For the same kind of chat in PocketPal, use this supported build instead:
Check Bonsai 27B (1-bit)