Can Ternary Bonsai 8B run on POCO X7 Pro?

YESRuns great
Formula estimate

What this means

Our estimate says Ternary Bonsai 8B should fit comfortably on your POCO X7 Pro.

Download the Q2_0 version, which is about 2.2 GB. We expect it to use about 3.5 GB of the roughly 9 GB available to a model on this phone.

At the estimated speed, a roughly 300-word answer may take about 29 seconds to finish.

This result is calculated from the phone and model specifications. It has not been measured on this exact phone and setup.

14tokens/s
estimated · faster than you read
3.5GB
needed at Q2_0
Q2_0
quant checked
needs 3.5 GBusable 9 GB
Dimensity 8400 Ultra12 GB RAMCPU / GPUAlso sold with 8 GB

See how fast it feels

Estimated at 14 tokens/s — faster than you read. A ~300-word reply takes about 29 seconds on this phone.

Live demo · 14 tokens/s

Where the memory goes

ComponentDetailGB
Model weightsQ2_0 GGUF (2.2 GB) + mmap overhead2.3
KV cache4K context window0.6
Runtimellama.cpp + app overhead0.6
Total neededat Q2_0, 4K context3.5
Working budget12 GB RAM Android system reserve9
Headroomremaining inside the working budget5.5

Pick your quant

QuantDownloadVerdictSpeed
Q2_0 BEST HERE2.2 GB Runs great~14 tokens/s
Q2_0_g64 2.3 GB Runs great~13.4 tokens/s

Use the supported phone path

The model fits in memory, but this exact download is not a PocketPal model.

The current App Store and Play Store versions of PocketPal cannot load this tracked ternary file. Memory fit does not make this exact download beginner-ready.

For the same kind of chat in PocketPal, use this supported build instead:

Check Bonsai 27B (1-bit)

Related checks

More on POCO X7 Pro
Qwen3 0.6BQwen3 1.7BLlama 3.2 1BLlama 3.2 3BGemma 3 1B
Ternary Bonsai 8B on other phones
Galaxy S25 UltraGalaxy S25Galaxy S24 UltraOnePlus 13OnePlus 12