Can AREX-2 27B run on Mac mini M4 16GB?
What this means
The checked Q4_K_M build needs about 20.8GB, above this Mac's conservative 13GB working budget.
Where the memory goes
| Component | Detail | GB |
|---|---|---|
| Model weights | Q4_K_M GGUF (17.2 GB) + mmap overhead | 18.1 |
| KV cache | 4K context window | 1.9 |
| Runtime | macOS inference app + compute buffers | 0.8 |
| Total needed | at Q4_K_M, 4K context | 20.8 |
| Working budget | 16 GB unified memory − conservative macOS reserve | 13 |
| Headroom | memory shortfall | −7.8 |
Pick your quant
| Quant | Download | Memory | Estimated speed | Verdict |
|---|---|---|---|---|
| Q2_K | 10.6 GB | 13.8 GB | — | ✕ Won't fit |
| Q3_K_M | 13.2 GB | 16.6 GB | — | ✕ Won't fit |
| IQ4_XS | 15.2 GB | 18.7 GB | — | ✕ Won't fit |
| Q4_0 | 16.1 GB | 19.6 GB | — | ✕ Won't fit |
| Q4_K_S | 16.1 GB | 19.6 GB | — | ✕ Won't fit |
| Q4_K_M ★ | 17.2 GB | 20.8 GB | — | ✕ Won't fit |
| Q5_K_M | 20.7 GB | 24.4 GB | — | ✕ Won't fit |
| Q6_K | 23.6 GB | 27.5 GB | — | ✕ Won't fit |
| Q8_0 | 28.7 GB | 32.8 GB | — | ✕ Won't fit |
Other models on this Mac
AREX-2 27B on other Mac mini M4 configurations
FAQ
Can the Mac mini M4 · 16GB run AREX-2 27B?
Not with the quants currently tracked. The selected Q4_K_M build needs about 20.8GB, above the 13GB working budget.
Which AREX-2 27B quant should I use on this Mac?
None of the tracked quants fit this configuration safely. Choose a smaller model or a Mac with more unified memory.
Which app should I use for AREX-2 27B on this Mac?
AREX-2 27B is a task-specific model, not a normal local chat download. The selected weights do not fit this Mac, and the model also needs its publisher's intended workflow. This page links that repository and recommends Qwen 3.6 27B if you just want local chat.
Are these speeds measured on a Mac mini M4?
No. The range is a formula estimate based on memory bandwidth, model size, active parameters, cooling, and a 4K context. The app, backend, thermals, and prompt can change real performance.