Ternary Bonsai 4B

At the default Q2_0, 139 of 140 phones have enough estimated usable memory; 139 also reach 3+ tokens/s. On Mac, 54 of 54 exact configurations pass using that quant or a smaller tracked fallback.

Params
4B
Family
bonsai
Released
2026-04
Tags
chat

Downloads & memory by quant

The download is only the weights — add KV cache and runtime to get what your phone actually needs. “Memory-fit” only means it can load; “usable” also requires an estimated 3+ tokens/s. Each row uses that row's quant. ★ = recommended.

QuantDownloadMemory neededPhone reality
Q2_01.1 GB~2 GB139 memory-fit · 139 usable
Q2_0_g641.1 GB~2 GB139 memory-fit · 139 usable

Ternary Bonsai 4B at Q2_0 on 140 phones

This table is fixed to the recommended Q2_0, on each phone's largest RAM option. Counts for smaller quants above will differ. All phones are shown, sorted by fit and estimated experience; tap one for the full report.

PhoneChip · RAMNeedsSpeedVerdict

~ = bandwidth-based estimate · ✓ = measured on real hardware

Ternary Bonsai 4B on 54 Mac configurations

Each Mac uses the recommended Q2_0 at 4K context when it fits, or the largest smaller tracked quant that fits. Each row links to the full report with a macOS-specific setup guide.

MacUnified memoryQuantWorking budgetNeedsEstimated speedVerdict

FAQ

How much RAM do I need to run Ternary Bonsai 4B on a phone?

At Q2_0, Ternary Bonsai 4B needs ~2GB of usable memory (weights + KV cache + runtime). In practice that means a 6GB+ Android phone or a 6GB+ iPhone — iOS lets a single app use less of its RAM than Android does.

How fast does Ternary Bonsai 4B run on a flagship phone?

On the Galaxy S25 Ultra (Snapdragon 8 Elite) it runs at ~31.4 tokens/s at Q2_0, estimated from memory bandwidth. Anything above ~8 tokens/s feels smooth for chat.

Can an iPhone run Ternary Bonsai 4B?

Yes — the iPhone 16 Pro Max runs it at ~24.5 tokens/s at Q2_0, using 2GB of its ~5.2GB usable memory.

What is the best quantization of Ternary Bonsai 4B for mobile?

Q2_0 (1.1GB download) is the size/quality sweet spot of the 2 quants available. Total memory needed is ~2GB once the KV cache and runtime are counted — the download size alone understates it.

How many phones can run Ternary Bonsai 4B?

139 of the 140 phones we track have enough estimated usable memory at Q2_0; 139 also reach our usable-speed threshold of 3 tokens/s, and 127 run smoothly. Memory-fit alone does not mean a good experience.

Which Macs can run Ternary Bonsai 4B?

54 of the 54 exact Mac configurations we track have enough estimated working memory. Each Mac uses the recommended Q2_0 when it fits, or the largest smaller tracked quant that fits, and separates installed unified memory, the macOS reserve, and estimated speed.

What is Ternary Bonsai 4B good for on a phone?

It's tagged for chat. At 4B parameters, it's a fast, lightweight pick for quick tasks.

Guides for Ternary

How to Run Bonsai 27B on Your Phone (iPhone & Android, Step by Step)
Can Your Phone Run Bonsai 27B? RAM Requirements & Speed Estimates (July 2026)
Bonsai 27B vs Qwen3.6 27B on Phones: Is 1-Bit Worth It?

Similar models

Bonsai 27B (1-bit)Ternary Bonsai 27BTernary Bonsai 8BTernary Bonsai 1.7BQwen3 4B