Can Gemma 4 E4B run on Xiaomi 17?
YES — Runs, barely
Grade A · 80/100 · formula estimate
What this means
The checked Q4_K_M version should run, but replies are likely to arrive slowly. The smaller Q4_0 version is the safer choice.
Download the Q4_0 version, which is about 4.8 GB. We expect it to use about 5.9 GB of the roughly 12 GB available to a model on this phone.
At the estimated speed, a roughly 300-word answer may take about 50 seconds to finish.
This result is calculated from the phone and model specifications. It has not been measured on this exact phone and setup.
7.6tokens/s
estimated · reading pace
6.1GB
needed at Q4_K_M
Q4_K_M
quant checked
A
grade · 80/100
needs 6.1 GBusable 12 GB
Snapdragon 8 Elite Gen 516 GB RAMCPU / GPUalso sold with 12 GB
Make it bearable
1
Drop to Q4_0 (4.8 GB) — it runs comfortably here at ~8 tokens/s. Recommended over Q4_K_M.
2
Drop context to 2K — saves ~0.2 GB of KV cache and a little speed.
3
Close every other app before loading — the 5.9 GB headroom is real; Android may kill the app otherwise.
4
Expect throttling after ~10 min of sustained generation on a phone chassis.
See how fast it feels
Estimated at 7.6 tokens/s — reading pace. A ~300-word reply takes about 53 seconds on this phone.
Where the memory goes
| Component | Detail | GB |
|---|---|---|
| Model weights | Q4_K_M GGUF (5 GB) + mmap overhead | 5.3 |
| KV cache | 4K context window | 0.3 |
| Runtime | llama.cpp + app overhead | 0.6 |
| Total needed | at Q4_K_M, 4K context | 6.1 |
| Usable on Xiaomi 17 | 16 GB RAM − Android system reserve | 12 |
| Headroom | left for the OS and your other apps | 5.9 |
Pick your quant
| Quant | Download | Verdict | Speed |
|---|---|---|---|
| Q3_K_M | 4.1 GB | ✓ Runs great | ~9.3 tokens/s |
| IQ4_XS | 4.7 GB | ✓ Runs great | ~8.1 tokens/s |
| Q4_0 BEST HERE | 4.8 GB | ✓ Runs great | ~8 tokens/s |
| Q4_K_S | 4.8 GB | ✓ Runs great | ~8 tokens/s |
| Q4_K_M | 5 GB | ! Runs, barely | ~7.6 tokens/s |
| Q5_K_M | 5.5 GB | ! Runs, barely | ~6.9 tokens/s |
| Q6_K | 7.1 GB | ! Runs, barely | ~5.4 tokens/s |
| Q8_0 | 8.2 GB | ! Runs, barely | ~4.7 tokens/s |
Get it running in 3 steps
1
Install PocketPal from the Play Store — free, no account needed.
2
Download "Gemma 4 E4B Q4_0" in the in-app model hub — 4.8 GB, use Wi-Fi. Search Hugging Face for
unsloth/gemma-4-E4B-it-GGUF and pick the Q4_0 file.3
Set context to 4K — expect ~8 tokens/s on this phone.
Related checks
MORE ON XIAOMI 17
GEMMA 4 E4B ON OTHER PHONES