Can Gemma 3 12B run on CMF Phone 2 Pro?
YES — Runs, barely
Grade B · 63/100 · formula estimate
What this means
Our estimate says Gemma 3 12B should fit, but replies are likely to arrive slowly.
Download the IQ1_S version, which is about 3.1 GB. We expect it to use about 4.7 GB of the roughly 6 GB available to a model on this phone.
At the estimated speed, a roughly 300-word answer may take about 2 minutes to finish.
This result is calculated from the phone and model specifications. It has not been measured on this exact phone and setup.
3.7tokens/s
estimated · reading pace
4.7GB
needed at IQ1_S
IQ1_S
quant checked
B
grade · 63/100
needs 4.7 GBusable 6 GB
Dimensity 73008 GB RAMCPU / GPU
Make it bearable
1
Drop context to 2K — saves ~0.5 GB of KV cache and a little speed.
2
Close every other app before loading — the 1.3 GB headroom is real; Android may kill the app otherwise.
3
Expect throttling after ~10 min of sustained generation on a phone chassis.
See how fast it feels
Estimated at 3.7 tokens/s — reading pace. A ~300-word reply takes about 108 seconds on this phone.
Where the memory goes
| Component | Detail | GB |
|---|---|---|
| Model weights | IQ1_S GGUF (3.1 GB) + mmap overhead | 3.3 |
| KV cache | 4K context window | 0.9 |
| Runtime | llama.cpp + app overhead | 0.6 |
| Total needed | at IQ1_S, 4K context | 4.7 |
| Usable on CMF Phone 2 Pro | 8 GB RAM − Android system reserve | 6 |
| Headroom | left for the OS and your other apps | 1.3 |
Pick your quant
| Quant | Download | Verdict | Speed |
|---|---|---|---|
| IQ1_S BEST HERE | 3.1 GB | ! Runs, barely | ~3.7 tokens/s |
| Q2_K | 4.8 GB | ✕ Won't fit | won't fit |
| Q3_K_M | 6 GB | ✕ Won't fit | won't fit |
| IQ4_XS | 6.6 GB | ✕ Won't fit | won't fit |
| Q4_0 | 6.9 GB | ✕ Won't fit | won't fit |
| Q4_K_S | 6.9 GB | ✕ Won't fit | won't fit |
| Q4_K_M | 7.3 GB | ✕ Won't fit | won't fit |
| Q5_K_M | 8.4 GB | ✕ Won't fit | won't fit |
| Q6_K | 9.7 GB | ✕ Won't fit | won't fit |
| Q8_0 | 12.5 GB | ✕ Won't fit | won't fit |
Get it running in 3 steps
1
Install PocketPal from the Play Store — free, no account needed.
2
Download "Gemma 3 12B IQ1_S" in the in-app model hub — 3.1 GB, use Wi-Fi. Search Hugging Face for
unsloth/gemma-3-12b-it-GGUF and pick the IQ1_S file.3
Set context to 4K — expect ~3.7 tokens/s on this phone.
Related checks
MORE ON CMF PHONE 2 PRO
GEMMA 3 12B ON OTHER PHONES