Can Gemma 3 4B run on OnePlus 12?
YES — Runs great
Grade S · 97/100 · formula estimate
What this means
Our estimate says Gemma 3 4B should fit comfortably on your OnePlus 12.
Download the Q4_K_M version, which is about 2.5 GB. We expect it to use about 3.5 GB of the roughly 20 GB available to a model on this phone.
At the estimated speed, a roughly 300-word answer may take about 29 seconds to finish.
This result is calculated from the phone and model specifications. It has not been measured on this exact phone and setup.
13.8tokens/s
estimated · faster than you read
3.5GB
needed at Q4_K_M
Q4_K_M
quant checked
S
grade · 97/100
needs 3.5 GBusable 20 GB
Snapdragon 8 Gen 324 GB RAMCPU / GPUalso sold with 12/16 GB
See how fast it feels
Estimated at 13.8 tokens/s — faster than you read. A ~300-word reply takes about 29 seconds on this phone.
Where the memory goes
| Component | Detail | GB |
|---|---|---|
| Model weights | Q4_K_M GGUF (2.5 GB) + mmap overhead | 2.6 |
| KV cache | 4K context window | 0.3 |
| Runtime | llama.cpp + app overhead | 0.6 |
| Total needed | at Q4_K_M, 4K context | 3.5 |
| Usable on OnePlus 12 | 24 GB RAM − Android system reserve | 20 |
| Headroom | left for the OS and your other apps | 16.5 |
Pick your quant
| Quant | Download | Verdict | Speed |
|---|---|---|---|
| IQ1_S | 1.2 GB | ✓ Runs great | ~28.8 tokens/s |
| Q2_K | 1.7 GB | ✓ Runs great | ~20.3 tokens/s |
| Q3_K_M | 2.1 GB | ✓ Runs great | ~16.5 tokens/s |
| IQ4_XS | 2.3 GB | ✓ Runs great | ~15 tokens/s |
| Q4_0 | 2.4 GB | ✓ Runs great | ~14.4 tokens/s |
| Q4_K_S | 2.4 GB | ✓ Runs great | ~14.4 tokens/s |
| Q4_K_M BEST HERE | 2.5 GB | ✓ Runs great | ~13.8 tokens/s |
| Q5_K_M | 2.8 GB | ✓ Runs great | ~12.3 tokens/s |
| Q6_K | 3.2 GB | ✓ Runs great | ~10.8 tokens/s |
| Q8_0 | 4.1 GB | ✓ Runs great | ~8.4 tokens/s |
Get it running in 3 steps
1
Install PocketPal from the Play Store — free, no account needed.
2
Download "Gemma 3 4B Q4_K_M" in the in-app model hub — 2.5 GB, use Wi-Fi. Search Hugging Face for
unsloth/gemma-3-4b-it-GGUF and pick the Q4_K_M file.3
Set context to 4K — expect ~13.8 tokens/s on this phone.
Related checks
MORE ON ONEPLUS 12
GEMMA 3 4B ON OTHER PHONES