aicanrun

Granite 4.2 8B

At the default Q4_K_M, 105 of 139 phones have enough estimated usable memory; 89 also reach 3+ tokens/s. On Mac, 54 of 54 exact configurations pass using that quant or a smaller tracked fallback.

Params
8B
Family
granite
Released
2026-08
Tags
chat · coding · reasoning
Weights
granite-4.2-8b-GGUF ↗

Downloads & memory by quant

The download is only the weights — add KV cache and runtime to get what your phone actually needs. “Memory-fit” only means it can load; “usable” also requires an estimated 3+ tokens/s. Each row uses that row's quant. ★ = recommended.

QuantDownloadMemory neededPhone reality
Q2_K3.4 GB~4.7 GB136 memory-fit · 125 usable
Q3_K_M4.3 GB~5.7 GB129 memory-fit · 97 usable
Q4_05.1 GB~6.5 GB105 memory-fit · 91 usable
Q4_K_S5.1 GB~6.5 GB105 memory-fit · 91 usable
Q4_K_M ★5.3 GB~6.7 GB105 memory-fit · 89 usable
Q5_K_M6.3 GB~7.8 GB105 memory-fit · 89 usable
Q6_K7.2 GB~8.7 GB102 memory-fit · 86 usable
Q8_09.3 GB~10.9 GB59 memory-fit · 59 usable

Granite 4.2 8B at Q4_K_M on 139 phones

This table is fixed to the recommended Q4_K_M, on each phone's largest RAM option. Counts for smaller quants above will differ. All phones are shown, sorted by fit and estimated experience; tap one for the full report.

PhoneChip · RAMNeedsSpeedVerdict
OPPO Find X8 ProDimensity 9400 · 16 GB6.7 / 12 GB~7.2 tokens/s! Runs, barely
vivo X200 ProDimensity 9400 · 16 GB6.7 / 12 GB~7.2 tokens/s! Runs, barely
Galaxy S26Snapdragon 8 Elite Gen 5 · 12 GB6.7 / 9 GB~7.2 tokens/s! Runs, barely
Galaxy S26+Snapdragon 8 Elite Gen 5 · 12 GB6.7 / 9 GB~7.2 tokens/s! Runs, barely
Galaxy S26 UltraSnapdragon 8 Elite Gen 5 · 16 GB6.7 / 12 GB~7.2 tokens/s! Runs, barely
Xiaomi 17Snapdragon 8 Elite Gen 5 · 16 GB6.7 / 12 GB~7.2 tokens/s! Runs, barely
Xiaomi 17 ProSnapdragon 8 Elite Gen 5 · 16 GB6.7 / 12 GB~7.2 tokens/s! Runs, barely
OnePlus 15Snapdragon 8 Elite Gen 5 · 16 GB6.7 / 12 GB~7.2 tokens/s! Runs, barely
vivo X300 ProDimensity 9500 · 16 GB6.7 / 12 GB~7.2 tokens/s! Runs, barely
OPPO Find X9 ProDimensity 9500 · 16 GB6.7 / 12 GB~7.2 tokens/s! Runs, barely
RedMagic 11S ProSnapdragon 8 Elite Gen 5 · 16 GB6.7 / 12 GB~7.2 tokens/s! Runs, barely
Xiaomi 15T ProDimensity 9400+ · 12 GB6.7 / 9 GB~7.2 tokens/s! Runs, barely
Honor Magic8 ProSnapdragon 8 Elite Gen 5 · 16 GB6.7 / 12 GB~7.2 tokens/s! Runs, barely
Xperia 1 VIIISnapdragon 8 Elite Gen 5 · 16 GB6.7 / 12 GB~7.2 tokens/s! Runs, barely
Galaxy Z Fold8Snapdragon 8 Elite Gen 5 · 16 GB6.7 / 12 GB~7.2 tokens/s! Runs, barely
Galaxy Z Fold8 UltraSnapdragon 8 Elite Gen 5 · 16 GB6.7 / 12 GB~7.2 tokens/s! Runs, barely
Galaxy Z Flip8Samsung Exynos 2600 · 12 GB6.7 / 9 GB~7.2 tokens/s! Runs, barely
Honor Magic V6Snapdragon 8 Elite Gen 5 · 16 GB6.7 / 12 GB~7.2 tokens/s! Runs, barely
HONOR Robot PhoneSnapdragon 8 Elite Gen 5 · 16 GB6.7 / 12 GB~7.2 tokens/s! Runs, barely
OPPO Find N6Snapdragon 8 Elite Gen 5 · 16 GB6.7 / 12 GB~7.2 tokens/s! Runs, barely
vivo X Fold6Dimensity 9500 · 16 GB6.7 / 12 GB~7.2 tokens/s! Runs, barely
Galaxy S25 UltraSnapdragon 8 Elite · 16 GB6.7 / 12 GB~6.5 tokens/s! Runs, barely
Galaxy S25Snapdragon 8 Elite · 12 GB6.7 / 9 GB~6.5 tokens/s! Runs, barely
Galaxy S24 UltraSnapdragon 8 Gen 3 · 12 GB6.7 / 9 GB~6.5 tokens/s! Runs, barely
OnePlus 13Snapdragon 8 Elite · 24 GB6.7 / 20 GB~6.5 tokens/s! Runs, barely
OnePlus 12Snapdragon 8 Gen 3 · 24 GB6.7 / 20 GB~6.5 tokens/s! Runs, barely
Xiaomi 15 ProSnapdragon 8 Elite · 16 GB6.7 / 12 GB~6.5 tokens/s! Runs, barely
Xiaomi 14Snapdragon 8 Gen 3 · 16 GB6.7 / 12 GB~6.5 tokens/s! Runs, barely
vivo X100 ProDimensity 9300 · 16 GB6.7 / 12 GB~6.5 tokens/s! Runs, barely
ROG Phone 9 ProSnapdragon 8 Elite · 24 GB6.7 / 20 GB~6.5 tokens/s! Runs, barely
Nothing Phone (3)Snapdragon 8s Gen 4 · 16 GB6.7 / 12 GB~6.5 tokens/s! Runs, barely
HONOR Magic7 ProSnapdragon 8 Elite · 16 GB6.7 / 12 GB~6.5 tokens/s! Runs, barely
vivo X300 ESnapdragon 8 Gen 5 · 12 GB6.7 / 9 GB~6.5 tokens/s! Runs, barely
Galaxy Z Fold6Snapdragon 8 Gen 3 · 12 GB6.7 / 9 GB~6.5 tokens/s! Runs, barely
Galaxy Z Flip6Snapdragon 8 Gen 3 · 12 GB6.7 / 9 GB~6.5 tokens/s! Runs, barely
Galaxy Z Fold7Snapdragon 8 Elite · 16 GB6.7 / 12 GB~6.5 tokens/s! Runs, barely
Galaxy Z Flip7Exynos 2500 · 12 GB6.7 / 9 GB~6.5 tokens/s! Runs, barely
Motorola Razr Ultra (2025)Snapdragon 8 Elite · 16 GB6.7 / 12 GB~6.5 tokens/s! Runs, barely
OnePlus 13RSnapdragon 8 Gen 3 · 16 GB6.7 / 12 GB~6.5 tokens/s! Runs, barely
OnePlus 15RSnapdragon 8 Gen 5 · 16 GB6.7 / 12 GB~6.5 tokens/s! Runs, barely
Motorola Razr Ultra (2026)Snapdragon 8 Elite · 16 GB6.7 / 12 GB~6.5 tokens/s! Runs, barely
RedMagic 11 AirSnapdragon 8 Elite · 16 GB6.7 / 12 GB~6.5 tokens/s! Runs, barely
Xperia 1 VIISnapdragon 8 Elite · 16 GB6.7 / 12 GB~6.5 tokens/s! Runs, barely
Xiaomi MIX Fold 4Snapdragon 8 Gen 3 · 16 GB6.7 / 12 GB~6.5 tokens/s! Runs, barely
Xiaomi MIX FlipSnapdragon 8 Gen 3 · 16 GB6.7 / 12 GB~6.5 tokens/s! Runs, barely
Xiaomi MIX Flip 2Snapdragon 8 Elite · 16 GB6.7 / 12 GB~6.5 tokens/s! Runs, barely
Honor Magic V3Snapdragon 8 Gen 3 · 16 GB6.7 / 12 GB~6.5 tokens/s! Runs, barely
Honor Magic V5Snapdragon 8 Elite · 16 GB6.7 / 12 GB~6.5 tokens/s! Runs, barely
OPPO Find N5Snapdragon 8 Elite · 16 GB6.7 / 12 GB~6.5 tokens/s! Runs, barely
vivo X Fold3 ProSnapdragon 8 Gen 3 · 16 GB6.7 / 12 GB~6.5 tokens/s! Runs, barely
vivo X Fold5Snapdragon 8 Gen 3 · 16 GB6.7 / 12 GB~6.5 tokens/s! Runs, barely
Huawei Mate X7Kirin 9030 Pro · 20 GB6.7 / 16 GB~6.5 tokens/s! Runs, barely
Motorola Razr FoldSnapdragon 8 Gen 5 · 16 GB6.7 / 12 GB~6.5 tokens/s! Runs, barely
Galaxy S24Samsung Exynos 2400 · 12 GB6.7 / 9 GB~5.7 tokens/s! Runs, barely
Galaxy S23 UltraSnapdragon 8 Gen 2 · 12 GB6.7 / 9 GB~5.7 tokens/s! Runs, barely
Pixel 9 ProGoogle Tensor G4 · 16 GB6.7 / 12 GB~5.8 tokens/s! Runs, barely
Pixel 9Google Tensor G4 · 12 GB6.7 / 9 GB~5.8 tokens/s! Runs, barely
Pixel 8 ProGoogle Tensor G3 · 12 GB6.7 / 9 GB~5.8 tokens/s! Runs, barely
POCO X6 ProDimensity 8300 Ultra · 12 GB6.7 / 9 GB~5.8 tokens/s! Runs, barely
Motorola Edge 50 UltraSnapdragon 8s Gen 3 · 16 GB6.7 / 12 GB~5.7 tokens/s! Runs, barely
Pixel 10Google Tensor G5 · 12 GB6.7 / 9 GB~5.8 tokens/s! Runs, barely
Pixel 10 ProGoogle Tensor G5 · 16 GB6.7 / 12 GB~5.8 tokens/s! Runs, barely
Pixel 11Google Tensor G6 · 12 GB6.7 / 9 GB~5.8 tokens/s! Runs, barely
Pixel 11 ProGoogle Tensor G6 · 16 GB6.7 / 12 GB~5.8 tokens/s! Runs, barely
Pixel 11 Pro XLGoogle Tensor G6 · 16 GB6.7 / 12 GB~5.8 tokens/s! Runs, barely
Pixel 9 Pro XLGoogle Tensor G4 · 16 GB6.7 / 12 GB~5.8 tokens/s! Runs, barely
Pixel 10 Pro XLGoogle Tensor G5 · 16 GB6.7 / 12 GB~5.8 tokens/s! Runs, barely
Motorola Razr+ (2026)Snapdragon 8s Gen 3 · 12 GB6.7 / 9 GB~5.7 tokens/s! Runs, barely
Xiaomi 15TDimensity 8400 Ultra · 12 GB6.7 / 9 GB~5.8 tokens/s! Runs, barely
POCO X7 ProDimensity 8400 Ultra · 12 GB6.7 / 9 GB~5.8 tokens/s! Runs, barely
AQUOS R10Snapdragon 7+ Gen 3 · 12 GB6.7 / 9 GB~5.7 tokens/s! Runs, barely
Galaxy Z Fold5Snapdragon 8 Gen 2 · 12 GB6.7 / 9 GB~5.7 tokens/s! Runs, barely
Xiaomi MIX Fold 3Snapdragon 8 Gen 2 · 16 GB6.7 / 12 GB~5.7 tokens/s! Runs, barely
Honor Magic V2Snapdragon 8 Gen 2 · 16 GB6.7 / 12 GB~5.7 tokens/s! Runs, barely
OPPO Find N3Snapdragon 8 Gen 2 · 16 GB6.7 / 12 GB~5.7 tokens/s! Runs, barely
OnePlus OpenSnapdragon 8 Gen 2 · 16 GB6.7 / 12 GB~5.7 tokens/s! Runs, barely
vivo X Fold3Snapdragon 8 Gen 2 · 16 GB6.7 / 12 GB~5.7 tokens/s! Runs, barely
Pixel 9 Pro FoldGoogle Tensor G4 · 16 GB6.7 / 12 GB~5.8 tokens/s! Runs, barely
Pixel 10 Pro FoldGoogle Tensor G5 · 16 GB6.7 / 12 GB~5.8 tokens/s! Runs, barely
Pixel 11 Pro FoldGoogle Tensor G6 · 16 GB6.7 / 12 GB~5.8 tokens/s! Runs, barely
Huawei Mate X6Kirin 9020 · 16 GB6.7 / 12 GB~5.8 tokens/s! Runs, barely
Motorola Razr+ (2024)Snapdragon 8s Gen 3 · 12 GB6.7 / 9 GB~5.7 tokens/s! Runs, barely
Motorola Razr+ (2025)Snapdragon 8s Gen 3 · 12 GB6.7 / 9 GB~5.7 tokens/s! Runs, barely
Xiaomi MIX Fold 2Snapdragon 8+ Gen 1 · 12 GB6.7 / 9 GB~4.3 tokens/s! Runs, barely
Pixel FoldTensor G2 · 12 GB6.7 / 9 GB~4.3 tokens/s! Runs, barely
Motorola Razr+ (2023)Snapdragon 8+ Gen 1 · 12 GB6.7 / 9 GB~4.3 tokens/s! Runs, barely
iPhone AirApple A19 Pro · 12 GB6.7 / 7.8 GB~6.5 tokens/s! Runs, barely
iPhone 17 ProApple A19 Pro · 12 GB6.7 / 7.8 GB~6.5 tokens/s! Runs, barely
iPhone 17 Pro MaxApple A19 Pro · 12 GB6.7 / 7.8 GB~6.5 tokens/s! Runs, barely
Galaxy A57 5GExynos 1680 · 12 GB6.7 / 9 GB~2.9 tokens/s! Runs, barely
Nothing Phone (4a) ProSnapdragon 7 Gen 4 · 12 GB6.7 / 9 GB~2.9 tokens/s! Runs, barely
Galaxy A55Exynos 1480 · 12 GB6.7 / 9 GB~2.2 tokens/s! Runs, barely
Redmi Note 13 ProSnapdragon 7s Gen 2 · 12 GB6.7 / 9 GB~2.2 tokens/s! Runs, barely
Nothing Phone (2a)Dimensity 7200 Pro · 12 GB6.7 / 9 GB~2.2 tokens/s! Runs, barely
Nothing Phone (3a)Snapdragon 7s Gen 3 · 12 GB6.7 / 9 GB~2.2 tokens/s! Runs, barely
Galaxy A36 5GSnapdragon 6 Gen 3 · 12 GB6.7 / 9 GB~2.2 tokens/s! Runs, barely
Galaxy A56 5GExynos 1580 · 12 GB6.7 / 9 GB~2.2 tokens/s! Runs, barely
Galaxy A37 5GExynos 1480 · 12 GB6.7 / 9 GB~2.2 tokens/s! Runs, barely
Redmi Note 14 Pro 5GDimensity 7300 · 12 GB6.7 / 9 GB~2.2 tokens/s! Runs, barely
Redmi Note 15 Pro 5GDimensity 7400 Ultra · 12 GB6.7 / 9 GB~2.2 tokens/s! Runs, barely
Redmi Note 15 5GSnapdragon 6 Gen 3 · 12 GB6.7 / 9 GB~2.2 tokens/s! Runs, barely
Redmi Note 14 Pro+ 5GSnapdragon 7s Gen 3 · 12 GB6.7 / 9 GB~2.2 tokens/s! Runs, barely
Redmi Note 15 Pro+ 5GSnapdragon 7s Gen 4 · 12 GB6.7 / 9 GB~2.2 tokens/s! Runs, barely
Honor 400Snapdragon 7 Gen 3 · 12 GB6.7 / 9 GB~2.2 tokens/s! Runs, barely
Motorola Razr (2024)Dimensity 7300X · 12 GB6.7 / 9 GB~1.5 tokens/s! Runs, barely
Pixel 8aGoogle Tensor G3 · 8 GB6.7 / 6 GB—✕ Won't fit
Galaxy S26 FEExynos 2500 · 8 GB6.7 / 6 GB—✕ Won't fit
Pixel 9aGoogle Tensor G4 · 8 GB6.7 / 6 GB—✕ Won't fit
Galaxy S25 FESamsung Exynos 2400 · 8 GB6.7 / 6 GB—✕ Won't fit
Galaxy A16 5GExynos 1330 · 8 GB6.7 / 6 GB—✕ Won't fit
Galaxy A17 5GExynos 1330 · 8 GB6.7 / 6 GB—✕ Won't fit
Galaxy A26 5GExynos 1380 · 8 GB6.7 / 6 GB—✕ Won't fit
Moto G (2025)Dimensity 6300 · 8 GB6.7 / 6 GB—✕ Won't fit
Moto G Power (2025)Dimensity 6300 · 8 GB6.7 / 6 GB—✕ Won't fit
Moto G Stylus (2025)Snapdragon 6 Gen 3 · 8 GB6.7 / 6 GB—✕ Won't fit
Moto G Power (2026)Dimensity 6300 · 8 GB6.7 / 6 GB—✕ Won't fit
Moto G Stylus (2026)Snapdragon 6 Gen 3 · 8 GB6.7 / 6 GB—✕ Won't fit
Motorola Razr (2025)Dimensity 7400X · 8 GB6.7 / 6 GB—✕ Won't fit
Pixel 10aGoogle Tensor G4 · 8 GB6.7 / 6 GB—✕ Won't fit
Motorola Razr (2026)Dimensity 7450X · 8 GB6.7 / 6 GB—✕ Won't fit
Motorola Edge (2026)Dimensity 7450 · 8 GB6.7 / 6 GB—✕ Won't fit
CMF Phone 2 ProDimensity 7300 · 8 GB6.7 / 6 GB—✕ Won't fit
AQUOS sense10Snapdragon 7s Gen 3 · 8 GB6.7 / 6 GB—✕ Won't fit
AQUOS sense9Snapdragon 7s Gen 2 · 8 GB6.7 / 6 GB—✕ Won't fit
Xperia 10 VIISnapdragon 6 Gen 3 · 8 GB6.7 / 6 GB—✕ Won't fit
Galaxy Z Flip5Snapdragon 8 Gen 2 · 8 GB6.7 / 6 GB—✕ Won't fit
Redmi Note 17Snapdragon 4 Gen 4 · 8 GB6.7 / 6 GB—✕ Won't fit
vivo S2Dimensity 7360-Turbo · 8 GB6.7 / 6 GB—✕ Won't fit
iQOO Z11 LiteDimensity 6300 · 8 GB6.7 / 6 GB—✕ Won't fit
iPhone 16 Pro MaxApple A18 Pro · 8 GB6.7 / 5.2 GB—✕ Won't fit
iPhone 16 ProApple A18 Pro · 8 GB6.7 / 5.2 GB—✕ Won't fit
iPhone 16Apple A18 · 8 GB6.7 / 5.2 GB—✕ Won't fit
iPhone 15 ProApple A17 Pro · 8 GB6.7 / 5.2 GB—✕ Won't fit
iPhone 17Apple A19 · 8 GB6.7 / 5.2 GB—✕ Won't fit
iPhone 16eApple A18 · 8 GB6.7 / 5.2 GB—✕ Won't fit
iPhone 17eApple A19 · 8 GB6.7 / 5.2 GB—✕ Won't fit
iPhone 15Apple A16 Bionic · 6 GB6.7 / 3.9 GB—✕ Won't fit
iPhone 14Apple A15 Bionic · 6 GB6.7 / 3.9 GB—✕ Won't fit
Moto G (2026)Dimensity 6300 · 4 GB6.7 / 2 GB—✕ Won't fit

~ = bandwidth-based estimate · ✓ = measured on real hardware

Granite 4.2 8B on 54 Mac configurations

Each Mac uses the recommended Q4_K_M at 4K context when it fits, or the largest smaller tracked quant that fits. Each row links to the full report with a macOS-specific setup guide.

MacUnified memoryQuantWorking budgetNeedsEstimated speedVerdict
Mac Studio M5 Ultra512 GBQ4_K_M504 GB6.9 GB~113.2–158.5 tokens/s✓ Runs great
Mac Studio M3 Ultra512 GBQ4_K_M504 GB6.9 GB~77.3–108.2 tokens/s✓ Runs great
Mac Studio M5 Ultra256 GBQ4_K_M248 GB6.9 GB~113.2–158.5 tokens/s✓ Runs great
Mac Studio M3 Ultra256 GBQ4_K_M248 GB6.9 GB~77.3–108.2 tokens/s✓ Runs great
Mac Studio M5 Max128 GBQ4_K_M120 GB6.9 GB~57.9–81.1 tokens/s✓ Runs great
MacBook Pro M5 Max128 GBQ4_K_M120 GB6.9 GB~57.9–81.1 tokens/s✓ Runs great
Mac Studio M4 Max128 GBQ4_K_M120 GB6.9 GB~51.5–72.1 tokens/s✓ Runs great
MacBook Pro M4 Max128 GBQ4_K_M120 GB6.9 GB~51.5–72.1 tokens/s✓ Runs great
MacBook Pro M3 Max128 GBQ4_K_M120 GB6.9 GB~37.7–52.8 tokens/s✓ Runs great
Mac Studio M5 Ultra96 GBQ4_K_M88 GB6.9 GB~113.2–158.5 tokens/s✓ Runs great
Mac Studio M3 Ultra96 GBQ4_K_M88 GB6.9 GB~77.3–108.2 tokens/s✓ Runs great
Mac mini M5 Pro64 GBQ4_K_M57.6 GB6.9 GB~29–40.5 tokens/s✓ Runs great
Mac Studio M5 Max64 GBQ4_K_M57.6 GB6.9 GB~57.9–81.1 tokens/s✓ Runs great
MacBook Pro M5 Pro64 GBQ4_K_M57.6 GB6.9 GB~29–40.5 tokens/s✓ Runs great
MacBook Pro M5 Max64 GBQ4_K_M57.6 GB6.9 GB~57.9–81.1 tokens/s✓ Runs great
Mac Studio M4 Max64 GBQ4_K_M57.6 GB6.9 GB~51.5–72.1 tokens/s✓ Runs great
Mac mini M4 Pro64 GBQ4_K_M57.6 GB6.9 GB~25.8–36.1 tokens/s✓ Runs great
MacBook Pro M4 Max64 GBQ4_K_M57.6 GB6.9 GB~51.5–72.1 tokens/s✓ Runs great
MacBook Pro M3 Max64 GBQ4_K_M57.6 GB6.9 GB~37.7–52.8 tokens/s✓ Runs great
Mac mini M5 Pro48 GBQ4_K_M43.2 GB6.9 GB~29–40.5 tokens/s✓ Runs great
Mac Studio M5 Max48 GBQ4_K_M43.2 GB6.9 GB~57.9–81.1 tokens/s✓ Runs great
MacBook Pro M5 Pro48 GBQ4_K_M43.2 GB6.9 GB~29–40.5 tokens/s✓ Runs great
Mac Studio M4 Max48 GBQ4_K_M43.2 GB6.9 GB~51.5–72.1 tokens/s✓ Runs great
Mac mini M4 Pro48 GBQ4_K_M43.2 GB6.9 GB~25.8–36.1 tokens/s✓ Runs great
MacBook Pro M4 Pro48 GBQ4_K_M43.2 GB6.9 GB~25.8–36.1 tokens/s✓ Runs great
Mac Studio M5 Max36 GBQ4_K_M32.4 GB6.9 GB~43.4–60.8 tokens/s✓ Runs great
MacBook Pro M5 Max36 GBQ4_K_M32.4 GB6.9 GB~43.4–60.8 tokens/s✓ Runs great
Mac Studio M4 Max36 GBQ4_K_M32.4 GB6.9 GB~38.7–54.2 tokens/s✓ Runs great
MacBook Pro M4 Max36 GBQ4_K_M32.4 GB6.9 GB~38.7–54.2 tokens/s✓ Runs great
MacBook Pro M3 Pro36 GBQ4_K_M32.4 GB6.9 GB~14.2–19.8 tokens/s✓ Runs great
MacBook Pro M3 Max36 GBQ4_K_M32.4 GB6.9 GB~28.3–39.6 tokens/s✓ Runs great
Mac mini M632 GBQ4_K_M28.8 GB6.9 GB~16–22.5 tokens/s✓ Runs great
Mac mini M5 Pro32 GBQ4_K_M28.8 GB6.9 GB~29–40.5 tokens/s✓ Runs great
MacBook Air M532 GBQ4_K_M28.8 GB6.9 GB~12.1–16.7 tokens/s✓ Runs great
MacBook Air M432 GBQ4_K_M28.8 GB6.9 GB~9.5–13.1 tokens/s✓ Runs great
Mac mini M432 GBQ4_K_M28.8 GB6.9 GB~11.3–15.8 tokens/s✓ Runs great
Mac mini M624 GBQ4_K_M21 GB6.9 GB~16–22.5 tokens/s✓ Runs great
Mac mini M5 Pro24 GBQ4_K_M21 GB6.9 GB~29–40.5 tokens/s✓ Runs great
MacBook Air M524 GBQ4_K_M21 GB6.9 GB~12.1–16.7 tokens/s✓ Runs great
MacBook Pro M5 Pro24 GBQ4_K_M21 GB6.9 GB~29–40.5 tokens/s✓ Runs great
MacBook Air M424 GBQ4_K_M21 GB6.9 GB~9.5–13.1 tokens/s✓ Runs great
Mac mini M424 GBQ4_K_M21 GB6.9 GB~11.3–15.8 tokens/s✓ Runs great
Mac mini M4 Pro24 GBQ4_K_M21 GB6.9 GB~25.8–36.1 tokens/s✓ Runs great
MacBook Air M324 GBQ4_K_M21 GB6.9 GB~7.9–10.9 tokens/s✓ Runs great
MacBook Pro M4 Pro24 GBQ4_K_M21 GB6.9 GB~25.8–36.1 tokens/s✓ Runs great
MacBook Pro M3 Pro18 GBQ4_K_M15 GB6.9 GB~14.2–19.8 tokens/s✓ Runs great
Mac mini M616 GBQ4_K_M13 GB6.9 GB~16–22.5 tokens/s✓ Runs great
MacBook Air M516 GBQ4_K_M13 GB6.9 GB~12.1–16.7 tokens/s✓ Runs great
MacBook Air M416 GBQ4_K_M13 GB6.9 GB~9.5–13.1 tokens/s✓ Runs great
Mac mini M416 GBQ4_K_M13 GB6.9 GB~11.3–15.8 tokens/s✓ Runs great
MacBook Air M316 GBQ4_K_M13 GB6.9 GB~7.9–10.9 tokens/s✓ Runs great
MacBook Air M116 GBQ4_K_M13 GB6.9 GB~5.4–7.5 tokens/s✓ Runs great
MacBook Neo A18 Pro8 GBQ2_Ksmaller version5 GB4.9 GB~7.4–10.2 tokens/s! Runs, barely
MacBook Air M18 GBQ2_Ksmaller version5 GB4.9 GB~8.4–11.7 tokens/s! Runs, barely

FAQ

How much RAM do I need to run Granite 4.2 8B on a phone?

At Q4_K_M, Granite 4.2 8B needs ~6.7GB of usable memory (weights + KV cache + runtime). In practice that means a 12GB+ Android phone or a 12GB+ iPhone — iOS lets a single app use less of its RAM than Android does.

How fast does Granite 4.2 8B run on a flagship phone?

On the OPPO Find X8 Pro (Dimensity 9400) it runs at ~7.2 tokens/s at Q4_K_M, estimated from memory bandwidth. Anything above ~8 tokens/s feels smooth for chat.

Can an iPhone run Granite 4.2 8B?

Yes — the iPhone Air runs it at ~6.5 tokens/s at Q4_K_M, using 6.7GB of its ~7.8GB usable memory.

What is the best quantization of Granite 4.2 8B for mobile?

Q4_K_M (5.3GB download) is the size/quality sweet spot of the 8 quants available. Total memory needed is ~6.7GB once the KV cache and runtime are counted — the download size alone understates it.

How many phones can run Granite 4.2 8B?

105 of the 139 phones we track have enough estimated usable memory at Q4_K_M; 89 also reach our usable-speed threshold of 3 tokens/s, and 0 run smoothly. Memory-fit alone does not mean a good experience.

Which Macs can run Granite 4.2 8B?

54 of the 54 exact Mac configurations we track have enough estimated working memory. Each Mac uses the recommended Q4_K_M when it fits, or the largest smaller tracked quant that fits, and separates installed unified memory, the macOS reserve, and estimated speed.

What is Granite 4.2 8B good for on a phone?

It's tagged for chat, coding, reasoning. At 8B parameters, it balances quality and speed for daily use.

Similar models

Granite 4.2 3BGranite 4.2 30BLlama 3.1 8BMinistral 8BTernary Bonsai 8B