Can OneJev 4B run on iPhone 16 Pro?
Estimated weights fit · custom workflow required
Weight fit is not phone app support
The tracked Q4_K_M weights are 3.1GB; the generic working-memory estimate is 4.1GB against 5.2GB usable. Image inputs need additional projector memory.
OneJev scores typed decisions in a single forward pass, not chat replies. The decode estimates below are not measured decision latency. The publisher's qev server and System One client are required; AICanRun has not verified a phone app route.
Not measured
decision latency
4.1GB
needed at Q4_K_M
Q4_K_M
quant checked
needs 4.1 GBusable 5.2 GB
Apple A18 Pro8 GB RAMMetal
Where the memory goes
| Component | Detail | GB |
|---|---|---|
| Model weights | Q4_K_M GGUF (3.1 GB) + mmap overhead | 3.3 |
| KV cache | 4K context window | 0.3 |
| Runtime | llama.cpp + app overhead | 0.6 |
| Total needed | at Q4_K_M, 4K context | 4.1 |
| Working budget | 8 GB RAM − iOS reserve (jetsam limit) | 5.2 |
| Headroom | remaining inside the working budget | 1.1 |
Pick your quant
| Quant | Download | Verdict | Speed |
|---|---|---|---|
| Q2_K | 2.1 GB | ✓ Runs great | ~12.9 tokens/s |
| Q3_K_M | 2.5 GB | ✓ Runs great | ~10.8 tokens/s |
| IQ4_XS | 2.9 GB | ✓ Runs great | ~9.3 tokens/s |
| Q4_K_S | 2.9 GB | ✓ Runs great | ~9.3 tokens/s |
| Q4_K_M BEST HERE | 3.1 GB | ✓ Runs great | ~8.7 tokens/s |
| Q5_K_M | 3.5 GB | ! Runs, barely | ~7.7 tokens/s |
| Q6_K | 4 GB | ! Runs, barely | ~6.8 tokens/s |
| Q8_0 | 5.2 GB | ✕ Won't fit | won't fit |
Use the right workflow for this model
The model fits in memory, but it is not an ordinary chat model.
This model is designed to return calibrated probabilities for typed choices from text or images. PocketPal does not provide the required the publisher's qev server and System One client; image inputs also need a vision projector, so the tracked file is not a beginner phone-chat path.
Read the publisher workflow ↗If you only want a normal private chat, use this simpler model instead:
Check Llama 3.2 3BRelated checks
More on iPhone 16 Pro
OneJev 4B on other phones