Bonsai 27B (1-bit)

At the default Q1_0, 137 of 140 phones have enough estimated usable memory; 125 also reach 3+ tokens/s. On Mac, 54 of 54 exact configurations pass using that quant or a smaller tracked fallback.

Params
27B
Family
bonsai
Released
2026-07
Tags
chat · coding · vision · reasoning

Downloads & memory by quant

The download is only the weights — add KV cache and runtime to get what your phone actually needs. “Memory-fit” only means it can load; “usable” also requires an estimated 3+ tokens/s. Each row uses that row's quant. ★ = recommended.

QuantDownloadMemory neededPhone reality
Q1_03.8 GB~4.8 GB137 memory-fit · 125 usable

Bonsai 27B (1-bit) at Q1_0 on 140 phones

This table is fixed to the recommended Q1_0, on each phone's largest RAM option. Counts for smaller quants above will differ. All phones are shown, sorted by fit and estimated experience; tap one for the full report.

PhoneChip · RAMNeedsSpeedVerdict

~ = bandwidth-based estimate · ✓ = measured on real hardware

Bonsai 27B (1-bit) on 54 Mac configurations

Each Mac uses the recommended Q1_0 at 4K context when it fits, or the largest smaller tracked quant that fits. Each row links to the full report with a macOS-specific setup guide.

MacUnified memoryQuantWorking budgetNeedsEstimated speedVerdict

FAQ

How much RAM do I need to run Bonsai 27B (1-bit) on a phone?

At Q1_0, Bonsai 27B (1-bit) needs ~4.8GB of usable memory (weights + KV cache + runtime). In practice that means a 8GB+ Android phone or a 8GB+ iPhone — iOS lets a single app use less of its RAM than Android does.

How fast does Bonsai 27B (1-bit) run on a flagship phone?

On the OPPO Find X8 Pro (Dimensity 9400) it runs at ~10.1 tokens/s at Q1_0, estimated from memory bandwidth. Anything above ~8 tokens/s feels smooth for chat.

Can an iPhone run Bonsai 27B (1-bit)?

Yes — the iPhone Air runs it at ~9.1 tokens/s at Q1_0, using 4.8GB of its ~7.8GB usable memory.

What is the best quantization of Bonsai 27B (1-bit) for mobile?

Q1_0 (3.8GB download) is the size/quality sweet spot. Total memory needed is ~4.8GB once the KV cache and runtime are counted — the download size alone understates it.

How many phones can run Bonsai 27B (1-bit)?

137 of the 140 phones we track have enough estimated usable memory at Q1_0; 125 also reach our usable-speed threshold of 3 tokens/s, and 92 run smoothly. Memory-fit alone does not mean a good experience.

Which Macs can run Bonsai 27B (1-bit)?

54 of the 54 exact Mac configurations we track have enough estimated working memory. Each Mac uses the recommended Q1_0 when it fits, or the largest smaller tracked quant that fits, and separates installed unified memory, the macOS reserve, and estimated speed.

What is Bonsai 27B (1-bit) good for on a phone?

It's tagged for chat, coding, vision, reasoning. At 27B parameters, it prioritizes answer quality over speed — expect slower decoding.

Guides for Bonsai

How to Run Bonsai 27B on Your Phone (iPhone & Android, Step by Step)
Can Your Phone Run Bonsai 27B? RAM Requirements & Speed Estimates (July 2026)
Bonsai 27B vs Qwen3.6 27B on Phones: Is 1-Bit Worth It?

Similar models

Ternary Bonsai 27BTernary Bonsai 8BTernary Bonsai 4BTernary Bonsai 1.7BQwen 3.5 27B