Can Bonsai 27B (1-bit) run on iPhone 16 Pro?
NO — Won't fit
Grade F · 23/100 · formula estimate
What this means
None of the versions we checked fit safely on this phone. The checked version needs about 6.5 GB, while we estimate that the model can use about 5.2 GB.
Try a smaller model, or use this model on a device with more memory.
This result is calculated from the phone and model specifications. It has not been measured on this exact phone and setup.
−1.3GB short
memory that doesn't exist here
6.5GB
needed at Q1_0
Q1_0
quant checked
F
grade · 23/100
needs 6.5 GBusable 5.2 GB · short 1.3 GB
Apple A18 Pro8 GB RAMMetal
Three ways forward
1
Try a smaller quant
No quant of Bonsai 27B (1-bit) fits this phone — even the smallest is too big. Options 2 and 3 are your real choices.
2
Same family, smaller
Ternary Bonsai 8B · PQ2_0 · 2.2 GB
✓ ~12.3 tokens/s here
check Ternary Bonsai 8B →3
Run it in the cloud
The full Bonsai 27B (1-bit), no download, at data-center speed — pay per token.
provider recommendations coming later
Where the memory goes
| Component | Detail | GB |
|---|---|---|
| Model weights | Q1_0 GGUF (3.8 GB) + mmap overhead | 4 |
| KV cache | 4K context window | 1.9 |
| Runtime | llama.cpp + app overhead | 0.6 |
| Total needed | at Q1_0, 4K context | 6.5 |
| Usable on iPhone 16 Pro | 8 GB RAM − iOS reserve (jetsam limit) | 5.2 |
| Headroom | missing — this memory doesn't exist | −1.3 |
Pick your quant
| Quant | Download | Verdict | Speed |
|---|---|---|---|
| Q1_0 | 3.8 GB | ✕ Won't fit | won't fit |
Related checks
MORE ON IPHONE 16 PRO
BONSAI 27B (1-BIT) ON OTHER PHONES