Can Holo4 35B-A3B run on MacBook Pro M5 Pro 24GB?
What this means
The checked Q4_K_M build needs about 25.6GB, above this Mac's conservative 21GB working budget.
Where the memory goes
| Component | Detail | GB |
|---|---|---|
| Model weights | Q4_K_M GGUF (21.3 GB) + mmap overhead | 22.4 |
| KV cache | 4K context window | 2.5 |
| Runtime | macOS inference app + compute buffers | 0.8 |
| Total needed | at Q4_K_M, 4K context | 25.6 |
| Working budget | 24 GB unified memory − conservative macOS reserve | 21 |
| Headroom | memory shortfall | −4.6 |
Pick your quant
| Quant | Download | Memory | Estimated speed | Verdict |
|---|---|---|---|---|
| Q4_K_M ★ | 21.3 GB | 25.6 GB | — | ✕ Won't fit |
Other models on this Mac
Holo4 35B-A3B on other MacBook Pro M5 Pro configurations
FAQ
Can the MacBook Pro M5 Pro · 24GB run Holo4 35B-A3B?
Not with the quants currently tracked. The selected Q4_K_M build needs about 25.6GB, above the 21GB working budget.
Which Holo4 35B-A3B quant should I use on this Mac?
None of the tracked quants fit this configuration safely. Choose a smaller model or a Mac with more unified memory.
Which app should I use for Holo4 35B-A3B on this Mac?
Holo4 35B-A3B is a task-specific model, not a normal local chat download. The selected weights do not fit this Mac, and the model also needs its publisher's intended workflow. This page links that repository and recommends Qwen 3.6 35B-A3B if you just want local chat.
Are these speeds measured on a MacBook Pro M5 Pro?
No. The range is a formula estimate based on memory bandwidth, model size, active parameters, cooling, and a 4K context. The app, backend, thermals, and prompt can change real performance.