Can OneJev 9B run on Mac mini M4 32GB?
What this means
OneJev 9B fits on the Mac mini M4 · 32GB at Q4_K_M. We estimate it uses 7.3GB of the conservative 28.8GB working budget.
OneJev scores typed decisions in one forward pass. Generic decode estimates are not decision latency; image inputs need additional projector memory. Use the publisher's qev server and System One client.
Where the memory goes
| Component | Detail | GB |
|---|---|---|
| Model weights | Q4_K_M GGUF (5.6 GB) + mmap overhead | 5.9 |
| KV cache | 4K context window | 0.6 |
| Runtime | macOS inference app + compute buffers | 0.8 |
| Total needed | at Q4_K_M, 4K context | 7.3 |
| Working budget | 32 GB unified memory − conservative macOS reserve | 28.8 |
| Headroom | remaining inside the working budget | 21.5 |
Pick your quant
| Quant | Download | Memory | Estimated speed | Verdict |
|---|---|---|---|---|
| Q2_K | 3.8 GB | 5.4 GB | ~15.8–22.1 tok/s | ✓ Runs great |
| Q3_K_M | 4.6 GB | 6.3 GB | ~13–18.3 tok/s | ✓ Runs great |
| IQ4_XS | 5.2 GB | 6.9 GB | ~11.5–16.2 tok/s | ✓ Runs great |
| Q4_K_S | 5.4 GB | 7.1 GB | ~11.1–15.6 tok/s | ✓ Runs great |
| Q4_K_M ★ | 5.6 GB | 7.3 GB | ~10.7–15 tok/s | ✓ Runs great |
| Q5_K_M | 6.5 GB | 8.3 GB | ~9.2–12.9 tok/s | ✓ Runs great |
| Q6_K | 7.4 GB | 9.2 GB | ~8.1–11.4 tok/s | ✓ Runs great |
| Q8_0 | 9.5 GB | 11.4 GB | ~6.3–8.8 tok/s | ✓ Runs great |
Use this model for its intended task
OneJev 9B is designed to return calibrated probabilities for typed choices from text or images. This Mac has enough working memory for the tracked Q4_K_M weights, but loading the file in a plain chat window does not supply the inputs, tools, or action loop that make the model useful.
It documents the intended workflow and supported developer runtimes. This is not yet a point-and-click setup for beginners, so do not install LM Studio expecting an ordinary chat tutorial to reproduce the model's task.
Choose Llama 3.2 3B instead. Its page gives the complete graphical install, download, first prompt, and offline check.
This model is designed to return calibrated probabilities for typed choices from text or images. Its weights may fit in memory, but it needs the publisher's qev server and System One client; image inputs also need a vision projector. A normal LM Studio chat does not provide that workflow.
Other models on this Mac
OneJev 9B on other Mac mini M4 configurations
FAQ
Can the Mac mini M4 · 32GB run OneJev 9B?
The tracked Q4_K_M working memory is estimated at 7.3GB, excluding the vision projector. Weight fit is not verified workflow support; use the publisher's qev server and System One client.
Which OneJev 9B quant should I use on this Mac?
Q4_K_M. It is a 5.6GB download and leaves about 21.5GB inside our conservative working budget.
Which app should I use for OneJev 9B on this Mac?
OneJev 9B is a task-specific model, not a normal local chat download. The selected weights fit this Mac, but the model still needs its publisher's intended workflow. This page links that repository and recommends Llama 3.2 3B if you just want local chat.
Are these speeds measured on a Mac mini M4?
Decision latency has not been measured. OneJev scores typed choices in one forward pass; generic decode estimates do not measure this workflow.