Can Mistral 7B v0.3 run on Motorola Razr (2024)?
YES — Runs, barely
Grade B · 65/100 · formula estimate
What this means
Our estimate says Mistral 7B v0.3 should fit, but replies are likely to arrive slowly.
Download the Q4_K_M version, which is about 4.4 GB. We expect it to use about 5.7 GB of the roughly 9 GB available to a model on this phone.
At the estimated speed, a roughly 300-word answer may take about 4 minutes to finish.
This result is calculated from the phone and model specifications. It has not been measured on this exact phone and setup.
1.7tokens/s
estimated · slower than you read
5.7GB
needed at Q4_K_M
Q4_K_M
quant checked
B
grade · 65/100
needs 5.7 GBusable 9 GB
Dimensity 7300X12 GB RAMCPU / GPUalso sold with 8 GB
Make it bearable
1
Drop context to 2K — saves ~0.3 GB of KV cache and a little speed.
2
Close every other app before loading — the 3.3 GB headroom is real; Android may kill the app otherwise.
3
Expect throttling after ~10 min of sustained generation on a phone chassis.
See how fast it feels
Estimated at 1.7 tokens/s — slower than you read. A ~300-word reply takes about 235 seconds on this phone.
Where the memory goes
| Component | Detail | GB |
|---|---|---|
| Model weights | Q4_K_M GGUF (4.4 GB) + mmap overhead | 4.6 |
| KV cache | 4K context window | 0.5 |
| Runtime | llama.cpp + app overhead | 0.6 |
| Total needed | at Q4_K_M, 4K context | 5.7 |
| Usable on Motorola Razr (2024) | 12 GB RAM − Android system reserve | 9 |
| Headroom | left for the OS and your other apps | 3.3 |
Pick your quant
| Quant | Download | Verdict | Speed |
|---|---|---|---|
| IQ1_S | 1.6 GB | ! Runs, barely | ~4.8 tokens/s |
| Q2_K | 2.7 GB | ! Runs, barely | ~2.9 tokens/s |
| Q3_K_M | 3.5 GB | ! Runs, barely | ~2.2 tokens/s |
| IQ4_XS | 3.9 GB | ! Runs, barely | ~2 tokens/s |
| Q4_K_S | 4.1 GB | ! Runs, barely | ~1.9 tokens/s |
| Q4_K_M BEST HERE | 4.4 GB | ! Runs, barely | ~1.7 tokens/s |
| Q5_K_M | 5.1 GB | ! Runs, barely | ~1.5 tokens/s |
| Q6_K | 5.9 GB | ! Runs, barely | ~1.3 tokens/s |
| Q8_0 | 7.7 GB | ✕ Won't fit | won't fit |
Get it running in 3 steps
1
Install PocketPal from the Play Store — free, no account needed.
2
Download "Mistral 7B v0.3 Q4_K_M" in the in-app model hub — 4.4 GB, use Wi-Fi. Search Hugging Face for
bartowski/Mistral-7B-Instruct-v0.3-GGUF and pick the Q4_K_M file.3
Set context to 4K — expect ~1.7 tokens/s on this phone.
Related checks
MORE ON MOTOROLA RAZR (2024)
MISTRAL 7B V0.3 ON OTHER PHONES