aicanrun

Can I run Holo4 35B-A3B locally?

The official Q4_K_M weights are 21.3GB, plus a separate 0.9GB vision projector, context and runtime memory. The model has 35B total parameters: 3B active does not mean a 3B download. A 32GB Mac is a more realistic starting point than a 24GB Mac, not a tested compatibility guarantee.

How to run Holo4 locally

The publisher provides Q4_K_M GGUF weights and mmproj.f16.gguf under Apache 2.0. Use a current multimodal llama.cpp runtime and load both files. The 21.3GB weights alone leave very little headroom on a 24GB machine; images, context, the projector and other applications add memory use.

Holo4 is a computer-use model, not a turnkey desktop agent. A separate harness must send screenshots, execute requested actions and return tool results. The publisher links hai-agents, but its current SDK quickstart uses a hosted API; that is not evidence of a fully local setup. AICanRun has not tested a local end-to-end harness or phone app, and tokens/s estimates do not measure task completion time.

Official GGUF weights and projector ↗ · Publisher model card ↗

Params
35B (3B active)
Family
holo4
Released
2026-09
Tags
vision · coding · reasoning
Weights
Holo4-35B-A3B-GGUF ↗

Downloads & memory by quant

The download is only the weights — add KV cache and runtime to get what your phone actually needs. “Memory-fit” only means it can load; “usable” also requires an estimated 3+ tokens/s. Each row uses that row's quant. ★ = recommended.

QuantDownloadMemory neededPhone reality
Q4_K_M ★21.3 GB~25.4 GB0 memory-fit

Holo4 35B-A3B at Q4_K_M on 151 phones

This table is fixed to the recommended Q4_K_M, on each phone's largest RAM option. Counts for smaller quants above will differ. All phones are shown, sorted by fit and estimated experience; tap one for the full report.

PhoneChip · RAMNeedsSpeedVerdict
OnePlus 13Snapdragon 8 Elite · 24 GB25.4 / 20 GB—✕ Won't fit
OnePlus 12Snapdragon 8 Gen 3 · 24 GB25.4 / 20 GB—✕ Won't fit
ROG Phone 9 ProSnapdragon 8 Elite · 24 GB25.4 / 20 GB—✕ Won't fit
Huawei Mate X7Kirin 9030 Pro · 20 GB25.4 / 16 GB—✕ Won't fit
Galaxy S25 UltraSnapdragon 8 Elite · 16 GB25.4 / 12 GB—✕ Won't fit
Galaxy S25Snapdragon 8 Elite · 12 GB25.4 / 9 GB—✕ Won't fit
Galaxy S24 UltraSnapdragon 8 Gen 3 · 12 GB25.4 / 9 GB—✕ Won't fit
Galaxy S24Samsung Exynos 2400 · 12 GB25.4 / 9 GB—✕ Won't fit
Galaxy S23 UltraSnapdragon 8 Gen 2 · 12 GB25.4 / 9 GB—✕ Won't fit
Galaxy A55Exynos 1480 · 12 GB25.4 / 9 GB—✕ Won't fit
iPhone 16 Pro MaxApple A18 Pro · 8 GB25.4 / 5.2 GB—✕ Won't fit
iPhone 16 ProApple A18 Pro · 8 GB25.4 / 5.2 GB—✕ Won't fit
iPhone 16Apple A18 · 8 GB25.4 / 5.2 GB—✕ Won't fit
iPhone 15 ProApple A17 Pro · 8 GB25.4 / 5.2 GB—✕ Won't fit
iPhone 15Apple A16 Bionic · 6 GB25.4 / 3.9 GB—✕ Won't fit
iPhone 14Apple A15 Bionic · 6 GB25.4 / 3.9 GB—✕ Won't fit
Pixel 9 ProGoogle Tensor G4 · 16 GB25.4 / 12 GB—✕ Won't fit
Pixel 9Google Tensor G4 · 12 GB25.4 / 9 GB—✕ Won't fit
Pixel 8 ProGoogle Tensor G3 · 12 GB25.4 / 9 GB—✕ Won't fit
Pixel 8aGoogle Tensor G3 · 8 GB25.4 / 6 GB—✕ Won't fit
Xiaomi 15 ProSnapdragon 8 Elite · 16 GB25.4 / 12 GB—✕ Won't fit
Xiaomi 14Snapdragon 8 Gen 3 · 16 GB25.4 / 12 GB—✕ Won't fit
Redmi Note 13 ProSnapdragon 7s Gen 2 · 12 GB25.4 / 9 GB—✕ Won't fit
POCO X6 ProDimensity 8300 Ultra · 12 GB25.4 / 9 GB—✕ Won't fit
OPPO Find X8 ProDimensity 9400 · 16 GB25.4 / 12 GB—✕ Won't fit
vivo X200 ProDimensity 9400 · 16 GB25.4 / 12 GB—✕ Won't fit
vivo X100 ProDimensity 9300 · 16 GB25.4 / 12 GB—✕ Won't fit
Nothing Phone (3)Snapdragon 8s Gen 4 · 16 GB25.4 / 12 GB—✕ Won't fit
Nothing Phone (2a)Dimensity 7200 Pro · 12 GB25.4 / 9 GB—✕ Won't fit
Motorola Edge 50 UltraSnapdragon 8s Gen 3 · 16 GB25.4 / 12 GB—✕ Won't fit
HONOR Magic7 ProSnapdragon 8 Elite · 16 GB25.4 / 12 GB—✕ Won't fit
iPhone 17Apple A19 · 8 GB25.4 / 5.2 GB—✕ Won't fit
iPhone AirApple A19 Pro · 12 GB25.4 / 7.8 GB—✕ Won't fit
iPhone 17 ProApple A19 Pro · 12 GB25.4 / 7.8 GB—✕ Won't fit
iPhone 17 Pro MaxApple A19 Pro · 12 GB25.4 / 7.8 GB—✕ Won't fit
Galaxy S26Snapdragon 8 Elite Gen 5 · 12 GB25.4 / 9 GB—✕ Won't fit
Galaxy S26+Snapdragon 8 Elite Gen 5 · 12 GB25.4 / 9 GB—✕ Won't fit
Galaxy S26 UltraSnapdragon 8 Elite Gen 5 · 16 GB25.4 / 12 GB—✕ Won't fit
Galaxy S26 FEExynos 2500 · 8 GB25.4 / 6 GB—✕ Won't fit
Xiaomi 17Snapdragon 8 Elite Gen 5 · 16 GB25.4 / 12 GB—✕ Won't fit
Xiaomi 17 ProSnapdragon 8 Elite Gen 5 · 16 GB25.4 / 12 GB—✕ Won't fit
Xiaomi 18 ProSnapdragon 8 Elite Gen 6 · 16 GB25.4 / 12 GB—✕ Won't fit
Xiaomi 18 Pro MaxSnapdragon 8 Elite Extreme Gen 6 · 16 GB25.4 / 12 GB—✕ Won't fit
Xiaomi 18 FoldXiaomi XRING O3 · 16 GB25.4 / 12 GB—✕ Won't fit
nubia NaviX UltraSnapdragon 8 Elite Gen 5 · 16 GB25.4 / 12 GB—✕ Won't fit
OnePlus 15Snapdragon 8 Elite Gen 5 · 16 GB25.4 / 12 GB—✕ Won't fit
vivo X300 ProDimensity 9500 · 16 GB25.4 / 12 GB—✕ Won't fit
vivo X500 ProDimensity 9600 Pro · 12 GB25.4 / 9 GB—✕ Won't fit
vivo X500 Pro MaxDimensity 9600 Pro · 16 GB25.4 / 12 GB—✕ Won't fit
vivo X300 ESnapdragon 8 Gen 5 · 12 GB25.4 / 9 GB—✕ Won't fit
OPPO Find X9 ProDimensity 9500 · 16 GB25.4 / 12 GB—✕ Won't fit
Pixel 10Google Tensor G5 · 12 GB25.4 / 9 GB—✕ Won't fit
Pixel 10 ProGoogle Tensor G5 · 16 GB25.4 / 12 GB—✕ Won't fit
Pixel 11Google Tensor G6 · 12 GB25.4 / 9 GB—✕ Won't fit
Pixel 11 ProGoogle Tensor G6 · 16 GB25.4 / 12 GB—✕ Won't fit
Pixel 11 Pro XLGoogle Tensor G6 · 16 GB25.4 / 12 GB—✕ Won't fit
iPhone 16eApple A18 · 8 GB25.4 / 5.2 GB—✕ Won't fit
Pixel 9aGoogle Tensor G4 · 8 GB25.4 / 6 GB—✕ Won't fit
Galaxy S25 FESamsung Exynos 2400 · 8 GB25.4 / 6 GB—✕ Won't fit
Nothing Phone (3a)Snapdragon 7s Gen 3 · 12 GB25.4 / 9 GB—✕ Won't fit
Galaxy A16 5GExynos 1330 · 8 GB25.4 / 6 GB—✕ Won't fit
Galaxy A17 5GExynos 1330 · 8 GB25.4 / 6 GB—✕ Won't fit
Galaxy A26 5GExynos 1380 · 8 GB25.4 / 6 GB—✕ Won't fit
Galaxy A36 5GSnapdragon 6 Gen 3 · 12 GB25.4 / 9 GB—✕ Won't fit
Galaxy A56 5GExynos 1580 · 12 GB25.4 / 9 GB—✕ Won't fit
Galaxy Z Fold6Snapdragon 8 Gen 3 · 12 GB25.4 / 9 GB—✕ Won't fit
Galaxy Z Flip6Snapdragon 8 Gen 3 · 12 GB25.4 / 9 GB—✕ Won't fit
Galaxy Z Fold7Snapdragon 8 Elite · 16 GB25.4 / 12 GB—✕ Won't fit
Galaxy Z Flip7Exynos 2500 · 12 GB25.4 / 9 GB—✕ Won't fit
Moto G (2025)Dimensity 6300 · 8 GB25.4 / 6 GB—✕ Won't fit
Moto G Power (2025)Dimensity 6300 · 8 GB25.4 / 6 GB—✕ Won't fit
Moto G Stylus (2025)Snapdragon 6 Gen 3 · 8 GB25.4 / 6 GB—✕ Won't fit
Moto G (2026)Dimensity 6300 · 4 GB25.4 / 2 GB—✕ Won't fit
Moto G Power (2026)Dimensity 6300 · 8 GB25.4 / 6 GB—✕ Won't fit
Moto G Stylus (2026)Snapdragon 6 Gen 3 · 8 GB25.4 / 6 GB—✕ Won't fit
Motorola Razr (2025)Dimensity 7400X · 8 GB25.4 / 6 GB—✕ Won't fit
Motorola Razr Ultra (2025)Snapdragon 8 Elite · 16 GB25.4 / 12 GB—✕ Won't fit
OnePlus 13RSnapdragon 8 Gen 3 · 16 GB25.4 / 12 GB—✕ Won't fit
OnePlus 15RSnapdragon 8 Gen 5 · 16 GB25.4 / 12 GB—✕ Won't fit
Pixel 9 Pro XLGoogle Tensor G4 · 16 GB25.4 / 12 GB—✕ Won't fit
Pixel 10 Pro XLGoogle Tensor G5 · 16 GB25.4 / 12 GB—✕ Won't fit
iPhone 17eApple A19 · 8 GB25.4 / 5.2 GB—✕ Won't fit
Pixel 10aGoogle Tensor G4 · 8 GB25.4 / 6 GB—✕ Won't fit
Galaxy A57 5GExynos 1680 · 12 GB25.4 / 9 GB—✕ Won't fit
Galaxy A37 5GExynos 1480 · 12 GB25.4 / 9 GB—✕ Won't fit
Motorola Razr (2026)Dimensity 7450X · 8 GB25.4 / 6 GB—✕ Won't fit
Motorola Razr+ (2026)Snapdragon 8s Gen 3 · 12 GB25.4 / 9 GB—✕ Won't fit
Motorola Razr Ultra (2026)Snapdragon 8 Elite · 16 GB25.4 / 12 GB—✕ Won't fit
Motorola Edge (2026)Dimensity 7450 · 8 GB25.4 / 6 GB—✕ Won't fit
Nothing Phone (4a) ProSnapdragon 7 Gen 4 · 12 GB25.4 / 9 GB—✕ Won't fit
RedMagic 11 AirSnapdragon 8 Elite · 16 GB25.4 / 12 GB—✕ Won't fit
RedMagic 11S ProSnapdragon 8 Elite Gen 5 · 16 GB25.4 / 12 GB—✕ Won't fit
Redmi Note 14 Pro 5GDimensity 7300 · 12 GB25.4 / 9 GB—✕ Won't fit
Redmi Note 15 Pro 5GDimensity 7400 Ultra · 12 GB25.4 / 9 GB—✕ Won't fit
Redmi Note 15 5GSnapdragon 6 Gen 3 · 12 GB25.4 / 9 GB—✕ Won't fit
Redmi Note 14 Pro+ 5GSnapdragon 7s Gen 3 · 12 GB25.4 / 9 GB—✕ Won't fit
Redmi Note 15 Pro+ 5GSnapdragon 7s Gen 4 · 12 GB25.4 / 9 GB—✕ Won't fit
Xiaomi 15TDimensity 8400 Ultra · 12 GB25.4 / 9 GB—✕ Won't fit
Xiaomi 15T ProDimensity 9400+ · 12 GB25.4 / 9 GB—✕ Won't fit
POCO X7 ProDimensity 8400 Ultra · 12 GB25.4 / 9 GB—✕ Won't fit
Xiaomi MIX Fold 2Snapdragon 8+ Gen 1 · 12 GB25.4 / 9 GB—✕ Won't fit
Honor 400Snapdragon 7 Gen 3 · 12 GB25.4 / 9 GB—✕ Won't fit
Honor Magic8 ProSnapdragon 8 Elite Gen 5 · 16 GB25.4 / 12 GB—✕ Won't fit
Honor Magic9Snapdragon 8 Elite Gen 5 · 16 GB25.4 / 12 GB—✕ Won't fit
Honor Magic9 Super EditionSnapdragon 8 Elite Gen 5 · 16 GB25.4 / 12 GB—✕ Won't fit
CMF Phone 2 ProDimensity 7300 · 8 GB25.4 / 6 GB—✕ Won't fit
AQUOS sense10Snapdragon 7s Gen 3 · 8 GB25.4 / 6 GB—✕ Won't fit
AQUOS sense9Snapdragon 7s Gen 2 · 8 GB25.4 / 6 GB—✕ Won't fit
AQUOS R10Snapdragon 7+ Gen 3 · 12 GB25.4 / 9 GB—✕ Won't fit
Xperia 10 VIISnapdragon 6 Gen 3 · 8 GB25.4 / 6 GB—✕ Won't fit
Xperia 1 VIISnapdragon 8 Elite · 16 GB25.4 / 12 GB—✕ Won't fit
Xperia 1 VIIISnapdragon 8 Elite Gen 5 · 16 GB25.4 / 12 GB—✕ Won't fit
Galaxy Z Fold8Snapdragon 8 Elite Gen 5 · 16 GB25.4 / 12 GB—✕ Won't fit
Galaxy Z Fold8 UltraSnapdragon 8 Elite Gen 5 · 16 GB25.4 / 12 GB—✕ Won't fit
Galaxy Z Flip8Samsung Exynos 2600 · 12 GB25.4 / 9 GB—✕ Won't fit
Galaxy Z Fold5Snapdragon 8 Gen 2 · 12 GB25.4 / 9 GB—✕ Won't fit
Galaxy Z Flip5Snapdragon 8 Gen 2 · 8 GB25.4 / 6 GB—✕ Won't fit
Xiaomi MIX Fold 3Snapdragon 8 Gen 2 · 16 GB25.4 / 12 GB—✕ Won't fit
Xiaomi MIX Fold 4Snapdragon 8 Gen 3 · 16 GB25.4 / 12 GB—✕ Won't fit
Xiaomi MIX FlipSnapdragon 8 Gen 3 · 16 GB25.4 / 12 GB—✕ Won't fit
Xiaomi MIX Flip 2Snapdragon 8 Elite · 16 GB25.4 / 12 GB—✕ Won't fit
Honor Magic V2Snapdragon 8 Gen 2 · 16 GB25.4 / 12 GB—✕ Won't fit
Honor Magic V3Snapdragon 8 Gen 3 · 16 GB25.4 / 12 GB—✕ Won't fit
Honor Magic V5Snapdragon 8 Elite · 16 GB25.4 / 12 GB—✕ Won't fit
Honor Magic V6Snapdragon 8 Elite Gen 5 · 16 GB25.4 / 12 GB—✕ Won't fit
HONOR Robot PhoneSnapdragon 8 Elite Gen 5 · 16 GB25.4 / 12 GB—✕ Won't fit
OPPO Find N3Snapdragon 8 Gen 2 · 16 GB25.4 / 12 GB—✕ Won't fit
OnePlus OpenSnapdragon 8 Gen 2 · 16 GB25.4 / 12 GB—✕ Won't fit
OPPO Find N5Snapdragon 8 Elite · 16 GB25.4 / 12 GB—✕ Won't fit
OPPO Find N6Snapdragon 8 Elite Gen 5 · 16 GB25.4 / 12 GB—✕ Won't fit
vivo X Fold3Snapdragon 8 Gen 2 · 16 GB25.4 / 12 GB—✕ Won't fit
vivo X Fold3 ProSnapdragon 8 Gen 3 · 16 GB25.4 / 12 GB—✕ Won't fit
vivo X Fold5Snapdragon 8 Gen 3 · 16 GB25.4 / 12 GB—✕ Won't fit
vivo X Fold6Dimensity 9500 · 16 GB25.4 / 12 GB—✕ Won't fit
Pixel FoldTensor G2 · 12 GB25.4 / 9 GB—✕ Won't fit
Pixel 9 Pro FoldGoogle Tensor G4 · 16 GB25.4 / 12 GB—✕ Won't fit
Pixel 10 Pro FoldGoogle Tensor G5 · 16 GB25.4 / 12 GB—✕ Won't fit
Pixel 11 Pro FoldGoogle Tensor G6 · 16 GB25.4 / 12 GB—✕ Won't fit
Huawei Mate X6Kirin 9020 · 16 GB25.4 / 12 GB—✕ Won't fit
Motorola Razr+ (2023)Snapdragon 8+ Gen 1 · 12 GB25.4 / 9 GB—✕ Won't fit
Motorola Razr (2024)Dimensity 7300X · 12 GB25.4 / 9 GB—✕ Won't fit
Motorola Razr+ (2024)Snapdragon 8s Gen 3 · 12 GB25.4 / 9 GB—✕ Won't fit
Motorola Razr+ (2025)Snapdragon 8s Gen 3 · 12 GB25.4 / 9 GB—✕ Won't fit
Motorola Razr FoldSnapdragon 8 Gen 5 · 16 GB25.4 / 12 GB—✕ Won't fit
Redmi Note 17Snapdragon 4 Gen 4 · 8 GB25.4 / 6 GB—✕ Won't fit
vivo S2Dimensity 7360-Turbo · 8 GB25.4 / 6 GB—✕ Won't fit
vivo V80 Lite 5G (Pakistan)Dimensity 7360-Turbo · 8 GB25.4 / 6 GB—✕ Won't fit
iQOO 16Snapdragon 8 Elite Extreme Gen 6 · 16 GB25.4 / 12 GB—✕ Won't fit
iQOO Z11 LiteDimensity 6300 · 8 GB25.4 / 6 GB—✕ Won't fit
vivo Y600iSnapdragon 4 Gen 2 · 6 GB25.4 / 4 GB—✕ Won't fit
REDMI 17C 5GDimensity 6300 · 4 GB25.4 / 2 GB—✕ Won't fit

~ = bandwidth-based estimate · ✓ = measured on real hardware

Holo4 35B-A3B on 54 Mac configurations

Each Mac uses the recommended Q4_K_M at 4K context when it fits, or the largest smaller tracked quant that fits. Each row links to the full report with a macOS-specific setup guide.

MacUnified memoryQuantWorking budgetNeedsEstimated speedVerdict
Mac Studio M5 Ultra512 GBQ4_K_M504 GB25.6 GB~328.6–460.1 tokens/s✓ Runs great
Mac Studio M3 Ultra512 GBQ4_K_M504 GB25.6 GB~224.3–314 tokens/s✓ Runs great
Mac Studio M5 Ultra256 GBQ4_K_M248 GB25.6 GB~328.6–460.1 tokens/s✓ Runs great
Mac Studio M3 Ultra256 GBQ4_K_M248 GB25.6 GB~224.3–314 tokens/s✓ Runs great
Mac Studio M5 Max128 GBQ4_K_M120 GB25.6 GB~168.2–235.4 tokens/s✓ Runs great
MacBook Pro M5 Max128 GBQ4_K_M120 GB25.6 GB~168.2–235.4 tokens/s✓ Runs great
Mac Studio M4 Max128 GBQ4_K_M120 GB25.6 GB~149.5–209.3 tokens/s✓ Runs great
MacBook Pro M4 Max128 GBQ4_K_M120 GB25.6 GB~149.5–209.3 tokens/s✓ Runs great
MacBook Pro M3 Max128 GBQ4_K_M120 GB25.6 GB~109.5–153.4 tokens/s✓ Runs great
Mac Studio M5 Ultra96 GBQ4_K_M88 GB25.6 GB~328.6–460.1 tokens/s✓ Runs great
Mac Studio M3 Ultra96 GBQ4_K_M88 GB25.6 GB~224.3–314 tokens/s✓ Runs great
Mac mini M5 Pro64 GBQ4_K_M57.6 GB25.6 GB~84.1–117.7 tokens/s✓ Runs great
Mac Studio M5 Max64 GBQ4_K_M57.6 GB25.6 GB~168.2–235.4 tokens/s✓ Runs great
MacBook Pro M5 Pro64 GBQ4_K_M57.6 GB25.6 GB~84.1–117.7 tokens/s✓ Runs great
MacBook Pro M5 Max64 GBQ4_K_M57.6 GB25.6 GB~168.2–235.4 tokens/s✓ Runs great
Mac Studio M4 Max64 GBQ4_K_M57.6 GB25.6 GB~149.5–209.3 tokens/s✓ Runs great
Mac mini M4 Pro64 GBQ4_K_M57.6 GB25.6 GB~74.8–104.7 tokens/s✓ Runs great
MacBook Pro M4 Max64 GBQ4_K_M57.6 GB25.6 GB~149.5–209.3 tokens/s✓ Runs great
MacBook Pro M3 Max64 GBQ4_K_M57.6 GB25.6 GB~109.5–153.4 tokens/s✓ Runs great
Mac mini M5 Pro48 GBQ4_K_M43.2 GB25.6 GB~84.1–117.7 tokens/s✓ Runs great
Mac Studio M5 Max48 GBQ4_K_M43.2 GB25.6 GB~168.2–235.4 tokens/s✓ Runs great
MacBook Pro M5 Pro48 GBQ4_K_M43.2 GB25.6 GB~84.1–117.7 tokens/s✓ Runs great
Mac Studio M4 Max48 GBQ4_K_M43.2 GB25.6 GB~149.5–209.3 tokens/s✓ Runs great
Mac mini M4 Pro48 GBQ4_K_M43.2 GB25.6 GB~74.8–104.7 tokens/s✓ Runs great
MacBook Pro M4 Pro48 GBQ4_K_M43.2 GB25.6 GB~74.8–104.7 tokens/s✓ Runs great
Mac Studio M5 Max36 GBQ4_K_M32.4 GB25.6 GB~126–176.4 tokens/s✓ Runs great
MacBook Pro M5 Max36 GBQ4_K_M32.4 GB25.6 GB~126–176.4 tokens/s✓ Runs great
Mac Studio M4 Max36 GBQ4_K_M32.4 GB25.6 GB~112.3–157.2 tokens/s✓ Runs great
MacBook Pro M4 Max36 GBQ4_K_M32.4 GB25.6 GB~112.3–157.2 tokens/s✓ Runs great
MacBook Pro M3 Pro36 GBQ4_K_M32.4 GB25.6 GB~41.1–57.5 tokens/s✓ Runs great
MacBook Pro M3 Max36 GBQ4_K_M32.4 GB25.6 GB~82.2–115 tokens/s✓ Runs great
Mac mini M632 GBQ4_K_M28.8 GB25.6 GB~46.6–65.2 tokens/s✓ Runs great
Mac mini M5 Pro32 GBQ4_K_M28.8 GB25.6 GB~84.1–117.7 tokens/s✓ Runs great
MacBook Air M532 GBQ4_K_M28.8 GB25.6 GB~35.2–48.6 tokens/s✓ Runs great
MacBook Air M432 GBQ4_K_M28.8 GB25.6 GB~27.6–38.1 tokens/s✓ Runs great
Mac mini M432 GBQ4_K_M28.8 GB25.6 GB~32.9–46 tokens/s✓ Runs great
Mac mini M624 GBQ4_K_M21 GB25.6 GB—✕ Won't fit
Mac mini M5 Pro24 GBQ4_K_M21 GB25.6 GB—✕ Won't fit
MacBook Air M524 GBQ4_K_M21 GB25.6 GB—✕ Won't fit
MacBook Pro M5 Pro24 GBQ4_K_M21 GB25.6 GB—✕ Won't fit
MacBook Air M424 GBQ4_K_M21 GB25.6 GB—✕ Won't fit
Mac mini M424 GBQ4_K_M21 GB25.6 GB—✕ Won't fit
Mac mini M4 Pro24 GBQ4_K_M21 GB25.6 GB—✕ Won't fit
MacBook Air M324 GBQ4_K_M21 GB25.6 GB—✕ Won't fit
MacBook Pro M4 Pro24 GBQ4_K_M21 GB25.6 GB—✕ Won't fit
MacBook Pro M3 Pro18 GBQ4_K_M15 GB25.6 GB—✕ Won't fit
Mac mini M616 GBQ4_K_M13 GB25.6 GB—✕ Won't fit
MacBook Air M516 GBQ4_K_M13 GB25.6 GB—✕ Won't fit
MacBook Air M416 GBQ4_K_M13 GB25.6 GB—✕ Won't fit
Mac mini M416 GBQ4_K_M13 GB25.6 GB—✕ Won't fit
MacBook Air M316 GBQ4_K_M13 GB25.6 GB—✕ Won't fit
MacBook Air M116 GBQ4_K_M13 GB25.6 GB—✕ Won't fit
MacBook Neo A18 Pro8 GBQ4_K_M5 GB25.6 GB—✕ Won't fit
MacBook Air M18 GBQ4_K_M5 GB25.6 GB—✕ Won't fit

FAQ

How much RAM do I need to run Holo4 35B-A3B on a phone?

At Q4_K_M, Holo4 35B-A3B needs ~25.4GB of usable memory (weights + KV cache + runtime). In practice that means no current Android phone or no current iPhone — iOS lets a single app use less of its RAM than Android does.

How fast does Holo4 35B-A3B run on a flagship phone?

It doesn't fit on any of the 151 phones we track at Q4_K_M — it needs ~25.4GB of usable memory.

Can an iPhone run Holo4 35B-A3B?

Not really: the best iPhone we track (iPhone 16 Pro Max) has ~5.2GB usable, but Holo4 35B-A3B needs 25.4GB at Q4_K_M.

What is the best quantization of Holo4 35B-A3B for mobile?

Q4_K_M (21.3GB download) is the size/quality sweet spot. Total memory needed is ~25.4GB once the KV cache and runtime are counted — the download size alone understates it.

How many phones can run Holo4 35B-A3B?

0 of the 151 phones we track have enough estimated usable memory at Q4_K_M; 0 also reach our usable-speed threshold of 3 tokens/s, and 0 run smoothly. Memory-fit alone does not mean a good experience.

Which Macs can run Holo4 35B-A3B?

36 of the 54 exact Mac configurations we track have enough estimated working memory. Each Mac uses the recommended Q4_K_M when it fits, or the largest smaller tracked quant that fits, and separates installed unified memory, the macOS reserve, and estimated speed.

What is Holo4 35B-A3B good for on a phone?

It's tagged for vision, coding, reasoning. At 35B parameters (3B active — it's a MoE, so it decodes faster than its size suggests), it prioritizes answer quality over speed — expect slower decoding.

Similar models

Qwen 3.5 35B-A3BQwen 3.6 35B-A3BOrnith 1.0 35B-A3BXYZ-Aquila mini 35B-A3BKAT-Coder V2.5 Dev