aicanrun

Gemma 4 12B

At the default Q4_0, 102 of 140 phones have enough estimated usable memory; 86 also reach 3+ tokens/s. On Mac, 52 of 54 exact configurations pass using that quant or a smaller tracked fallback.

Params
12B
Family
gemma
Released
2026-03
Tags
chat · vision · reasoning
Weights
gemma-4-12B-it-qat-q4_0-gguf ↗

Downloads & memory by quant

The download is only the weights — add KV cache and runtime to get what your phone actually needs. “Memory-fit” only means it can load; “usable” also requires an estimated 3+ tokens/s. Each row uses that row's quant. ★ = recommended.

QuantDownloadMemory neededPhone reality
Q4_0 ★7 GB~8.8 GB102 memory-fit · 86 usable

Gemma 4 12B at Q4_0 on 140 phones

This table is fixed to the recommended Q4_0, on each phone's largest RAM option. Counts for smaller quants above will differ. All phones are shown, sorted by fit and estimated experience; tap one for the full report.

PhoneChip · RAMNeedsSpeedVerdict
OPPO Find X8 ProDimensity 9400 · 16 GB8.8 / 12 GB~5.5 tokens/s! Runs, barely
vivo X200 ProDimensity 9400 · 16 GB8.8 / 12 GB~5.5 tokens/s! Runs, barely
Galaxy S26 UltraSnapdragon 8 Elite Gen 5 · 16 GB8.8 / 12 GB~5.5 tokens/s! Runs, barely
Xiaomi 17Snapdragon 8 Elite Gen 5 · 16 GB8.8 / 12 GB~5.5 tokens/s! Runs, barely
Xiaomi 17 ProSnapdragon 8 Elite Gen 5 · 16 GB8.8 / 12 GB~5.5 tokens/s! Runs, barely
OnePlus 15Snapdragon 8 Elite Gen 5 · 16 GB8.8 / 12 GB~5.5 tokens/s! Runs, barely
vivo X300 ProDimensity 9500 · 16 GB8.8 / 12 GB~5.5 tokens/s! Runs, barely
OPPO Find X9 ProDimensity 9500 · 16 GB8.8 / 12 GB~5.5 tokens/s! Runs, barely
RedMagic 11S ProSnapdragon 8 Elite Gen 5 · 16 GB8.8 / 12 GB~5.5 tokens/s! Runs, barely
Honor Magic8 ProSnapdragon 8 Elite Gen 5 · 16 GB8.8 / 12 GB~5.5 tokens/s! Runs, barely
Xperia 1 VIIISnapdragon 8 Elite Gen 5 · 16 GB8.8 / 12 GB~5.5 tokens/s! Runs, barely
Galaxy Z Fold8Snapdragon 8 Elite Gen 5 · 16 GB8.8 / 12 GB~5.5 tokens/s! Runs, barely
Galaxy Z Fold8 UltraSnapdragon 8 Elite Gen 5 · 16 GB8.8 / 12 GB~5.5 tokens/s! Runs, barely
Honor Magic V6Snapdragon 8 Elite Gen 5 · 16 GB8.8 / 12 GB~5.5 tokens/s! Runs, barely
HONOR Robot PhoneSnapdragon 8 Elite Gen 5 · 16 GB8.8 / 12 GB~5.5 tokens/s! Runs, barely
OPPO Find N6Snapdragon 8 Elite Gen 5 · 16 GB8.8 / 12 GB~5.5 tokens/s! Runs, barely
vivo X Fold6Dimensity 9500 · 16 GB8.8 / 12 GB~5.5 tokens/s! Runs, barely
Galaxy S25 UltraSnapdragon 8 Elite · 16 GB8.8 / 12 GB~4.9 tokens/s! Runs, barely
OnePlus 13Snapdragon 8 Elite · 24 GB8.8 / 20 GB~4.9 tokens/s! Runs, barely
OnePlus 12Snapdragon 8 Gen 3 · 24 GB8.8 / 20 GB~4.9 tokens/s! Runs, barely
Xiaomi 15 ProSnapdragon 8 Elite · 16 GB8.8 / 12 GB~4.9 tokens/s! Runs, barely
Xiaomi 14Snapdragon 8 Gen 3 · 16 GB8.8 / 12 GB~4.9 tokens/s! Runs, barely
vivo X100 ProDimensity 9300 · 16 GB8.8 / 12 GB~4.9 tokens/s! Runs, barely
ROG Phone 9 ProSnapdragon 8 Elite · 24 GB8.8 / 20 GB~4.9 tokens/s! Runs, barely
Nothing Phone (3)Snapdragon 8s Gen 4 · 16 GB8.8 / 12 GB~4.9 tokens/s! Runs, barely
HONOR Magic7 ProSnapdragon 8 Elite · 16 GB8.8 / 12 GB~4.9 tokens/s! Runs, barely
Galaxy Z Fold7Snapdragon 8 Elite · 16 GB8.8 / 12 GB~4.9 tokens/s! Runs, barely
Motorola Razr Ultra (2025)Snapdragon 8 Elite · 16 GB8.8 / 12 GB~4.9 tokens/s! Runs, barely
OnePlus 13RSnapdragon 8 Gen 3 · 16 GB8.8 / 12 GB~4.9 tokens/s! Runs, barely
OnePlus 15RSnapdragon 8 Gen 5 · 16 GB8.8 / 12 GB~4.9 tokens/s! Runs, barely
Motorola Razr Ultra (2026)Snapdragon 8 Elite · 16 GB8.8 / 12 GB~4.9 tokens/s! Runs, barely
RedMagic 11 AirSnapdragon 8 Elite · 16 GB8.8 / 12 GB~4.9 tokens/s! Runs, barely
Xperia 1 VIISnapdragon 8 Elite · 16 GB8.8 / 12 GB~4.9 tokens/s! Runs, barely
Xiaomi MIX Fold 4Snapdragon 8 Gen 3 · 16 GB8.8 / 12 GB~4.9 tokens/s! Runs, barely
Xiaomi MIX FlipSnapdragon 8 Gen 3 · 16 GB8.8 / 12 GB~4.9 tokens/s! Runs, barely
Xiaomi MIX Flip 2Snapdragon 8 Elite · 16 GB8.8 / 12 GB~4.9 tokens/s! Runs, barely
Honor Magic V3Snapdragon 8 Gen 3 · 16 GB8.8 / 12 GB~4.9 tokens/s! Runs, barely
Honor Magic V5Snapdragon 8 Elite · 16 GB8.8 / 12 GB~4.9 tokens/s! Runs, barely
OPPO Find N5Snapdragon 8 Elite · 16 GB8.8 / 12 GB~4.9 tokens/s! Runs, barely
vivo X Fold3 ProSnapdragon 8 Gen 3 · 16 GB8.8 / 12 GB~4.9 tokens/s! Runs, barely
vivo X Fold5Snapdragon 8 Gen 3 · 16 GB8.8 / 12 GB~4.9 tokens/s! Runs, barely
Huawei Mate X7Kirin 9030 Pro · 20 GB8.8 / 16 GB~4.9 tokens/s! Runs, barely
Motorola Razr FoldSnapdragon 8 Gen 5 · 16 GB8.8 / 12 GB~4.9 tokens/s! Runs, barely
Pixel 9 ProGoogle Tensor G4 · 16 GB8.8 / 12 GB~4.4 tokens/s! Runs, barely
Pixel 10 ProGoogle Tensor G5 · 16 GB8.8 / 12 GB~4.4 tokens/s! Runs, barely
Pixel 11 ProGoogle Tensor G6 · 16 GB8.8 / 12 GB~4.4 tokens/s! Runs, barely
Pixel 11 Pro XLGoogle Tensor G6 · 16 GB8.8 / 12 GB~4.4 tokens/s! Runs, barely
Pixel 9 Pro XLGoogle Tensor G4 · 16 GB8.8 / 12 GB~4.4 tokens/s! Runs, barely
Pixel 10 Pro XLGoogle Tensor G5 · 16 GB8.8 / 12 GB~4.4 tokens/s! Runs, barely
Pixel 9 Pro FoldGoogle Tensor G4 · 16 GB8.8 / 12 GB~4.4 tokens/s! Runs, barely
Pixel 10 Pro FoldGoogle Tensor G5 · 16 GB8.8 / 12 GB~4.4 tokens/s! Runs, barely
Pixel 11 Pro FoldGoogle Tensor G6 · 16 GB8.8 / 12 GB~4.4 tokens/s! Runs, barely
Huawei Mate X6Kirin 9020 · 16 GB8.8 / 12 GB~4.4 tokens/s! Runs, barely
Motorola Edge 50 UltraSnapdragon 8s Gen 3 · 16 GB8.8 / 12 GB~4.3 tokens/s! Runs, barely
Xiaomi MIX Fold 3Snapdragon 8 Gen 2 · 16 GB8.8 / 12 GB~4.3 tokens/s! Runs, barely
Honor Magic V2Snapdragon 8 Gen 2 · 16 GB8.8 / 12 GB~4.3 tokens/s! Runs, barely
OPPO Find N3Snapdragon 8 Gen 2 · 16 GB8.8 / 12 GB~4.3 tokens/s! Runs, barely
OnePlus OpenSnapdragon 8 Gen 2 · 16 GB8.8 / 12 GB~4.3 tokens/s! Runs, barely
vivo X Fold3Snapdragon 8 Gen 2 · 16 GB8.8 / 12 GB~4.3 tokens/s! Runs, barely
Galaxy S26Snapdragon 8 Elite Gen 5 · 12 GB8.8 / 9 GB~5.5 tokens/s! Runs, barely
Galaxy S26+Snapdragon 8 Elite Gen 5 · 12 GB8.8 / 9 GB~5.5 tokens/s! Runs, barely
Xiaomi 15T ProDimensity 9400+ · 12 GB8.8 / 9 GB~5.5 tokens/s! Runs, barely
Galaxy Z Flip8Samsung Exynos 2600 · 12 GB8.8 / 9 GB~5.5 tokens/s! Runs, barely
Galaxy S25Snapdragon 8 Elite · 12 GB8.8 / 9 GB~4.9 tokens/s! Runs, barely
Galaxy S24 UltraSnapdragon 8 Gen 3 · 12 GB8.8 / 9 GB~4.9 tokens/s! Runs, barely
vivo X300 ESnapdragon 8 Gen 5 · 12 GB8.8 / 9 GB~4.9 tokens/s! Runs, barely
Galaxy Z Fold6Snapdragon 8 Gen 3 · 12 GB8.8 / 9 GB~4.9 tokens/s! Runs, barely
Galaxy Z Flip6Snapdragon 8 Gen 3 · 12 GB8.8 / 9 GB~4.9 tokens/s! Runs, barely
Galaxy Z Flip7Exynos 2500 · 12 GB8.8 / 9 GB~4.9 tokens/s! Runs, barely
Galaxy S24Samsung Exynos 2400 · 12 GB8.8 / 9 GB~4.3 tokens/s! Runs, barely
Galaxy S23 UltraSnapdragon 8 Gen 2 · 12 GB8.8 / 9 GB~4.3 tokens/s! Runs, barely
Pixel 9Google Tensor G4 · 12 GB8.8 / 9 GB~4.4 tokens/s! Runs, barely
Pixel 8 ProGoogle Tensor G3 · 12 GB8.8 / 9 GB~4.4 tokens/s! Runs, barely
POCO X6 ProDimensity 8300 Ultra · 12 GB8.8 / 9 GB~4.4 tokens/s! Runs, barely
Pixel 10Google Tensor G5 · 12 GB8.8 / 9 GB~4.4 tokens/s! Runs, barely
Pixel 11Google Tensor G6 · 12 GB8.8 / 9 GB~4.4 tokens/s! Runs, barely
Motorola Razr+ (2026)Snapdragon 8s Gen 3 · 12 GB8.8 / 9 GB~4.3 tokens/s! Runs, barely
Xiaomi 15TDimensity 8400 Ultra · 12 GB8.8 / 9 GB~4.4 tokens/s! Runs, barely
POCO X7 ProDimensity 8400 Ultra · 12 GB8.8 / 9 GB~4.4 tokens/s! Runs, barely
AQUOS R10Snapdragon 7+ Gen 3 · 12 GB8.8 / 9 GB~4.3 tokens/s! Runs, barely
Galaxy Z Fold5Snapdragon 8 Gen 2 · 12 GB8.8 / 9 GB~4.3 tokens/s! Runs, barely
Motorola Razr+ (2024)Snapdragon 8s Gen 3 · 12 GB8.8 / 9 GB~4.3 tokens/s! Runs, barely
Motorola Razr+ (2025)Snapdragon 8s Gen 3 · 12 GB8.8 / 9 GB~4.3 tokens/s! Runs, barely
Xiaomi MIX Fold 2Snapdragon 8+ Gen 1 · 12 GB8.8 / 9 GB~3.3 tokens/s! Runs, barely
Pixel FoldTensor G2 · 12 GB8.8 / 9 GB~3.3 tokens/s! Runs, barely
Motorola Razr+ (2023)Snapdragon 8+ Gen 1 · 12 GB8.8 / 9 GB~3.3 tokens/s! Runs, barely
Galaxy A57 5GExynos 1680 · 12 GB8.8 / 9 GB~2.2 tokens/s! Runs, barely
Nothing Phone (4a) ProSnapdragon 7 Gen 4 · 12 GB8.8 / 9 GB~2.2 tokens/s! Runs, barely
Galaxy A55Exynos 1480 · 12 GB8.8 / 9 GB~1.6 tokens/s! Runs, barely
Redmi Note 13 ProSnapdragon 7s Gen 2 · 12 GB8.8 / 9 GB~1.6 tokens/s! Runs, barely
Nothing Phone (2a)Dimensity 7200 Pro · 12 GB8.8 / 9 GB~1.6 tokens/s! Runs, barely
Nothing Phone (3a)Snapdragon 7s Gen 3 · 12 GB8.8 / 9 GB~1.6 tokens/s! Runs, barely
Galaxy A36 5GSnapdragon 6 Gen 3 · 12 GB8.8 / 9 GB~1.6 tokens/s! Runs, barely
Galaxy A56 5GExynos 1580 · 12 GB8.8 / 9 GB~1.6 tokens/s! Runs, barely
Galaxy A37 5GExynos 1480 · 12 GB8.8 / 9 GB~1.6 tokens/s! Runs, barely
Redmi Note 14 Pro 5GDimensity 7300 · 12 GB8.8 / 9 GB~1.6 tokens/s! Runs, barely
Redmi Note 15 Pro 5GDimensity 7400 Ultra · 12 GB8.8 / 9 GB~1.6 tokens/s! Runs, barely
Redmi Note 15 5GSnapdragon 6 Gen 3 · 12 GB8.8 / 9 GB~1.6 tokens/s! Runs, barely
Redmi Note 14 Pro+ 5GSnapdragon 7s Gen 3 · 12 GB8.8 / 9 GB~1.6 tokens/s! Runs, barely
Redmi Note 15 Pro+ 5GSnapdragon 7s Gen 4 · 12 GB8.8 / 9 GB~1.6 tokens/s! Runs, barely
Honor 400Snapdragon 7 Gen 3 · 12 GB8.8 / 9 GB~1.6 tokens/s! Runs, barely
Motorola Razr (2024)Dimensity 7300X · 12 GB8.8 / 9 GB~1.1 tokens/s! Runs, barely
iPhone AirApple A19 Pro · 12 GB8.8 / 7.8 GB—✕ Won't fit
iPhone 17 ProApple A19 Pro · 12 GB8.8 / 7.8 GB—✕ Won't fit
iPhone 17 Pro MaxApple A19 Pro · 12 GB8.8 / 7.8 GB—✕ Won't fit
Pixel 8aGoogle Tensor G3 · 8 GB8.8 / 6 GB—✕ Won't fit
Galaxy S26 FEExynos 2500 · 8 GB8.8 / 6 GB—✕ Won't fit
Pixel 9aGoogle Tensor G4 · 8 GB8.8 / 6 GB—✕ Won't fit
Galaxy S25 FESamsung Exynos 2400 · 8 GB8.8 / 6 GB—✕ Won't fit
Galaxy A16 5GExynos 1330 · 8 GB8.8 / 6 GB—✕ Won't fit
Galaxy A17 5GExynos 1330 · 8 GB8.8 / 6 GB—✕ Won't fit
Galaxy A26 5GExynos 1380 · 8 GB8.8 / 6 GB—✕ Won't fit
Moto G (2025)Dimensity 6300 · 8 GB8.8 / 6 GB—✕ Won't fit
Moto G Power (2025)Dimensity 6300 · 8 GB8.8 / 6 GB—✕ Won't fit
Moto G Stylus (2025)Snapdragon 6 Gen 3 · 8 GB8.8 / 6 GB—✕ Won't fit
Moto G Power (2026)Dimensity 6300 · 8 GB8.8 / 6 GB—✕ Won't fit
Moto G Stylus (2026)Snapdragon 6 Gen 3 · 8 GB8.8 / 6 GB—✕ Won't fit
Motorola Razr (2025)Dimensity 7400X · 8 GB8.8 / 6 GB—✕ Won't fit
Pixel 10aGoogle Tensor G4 · 8 GB8.8 / 6 GB—✕ Won't fit
Motorola Razr (2026)Dimensity 7450X · 8 GB8.8 / 6 GB—✕ Won't fit
Motorola Edge (2026)Dimensity 7450 · 8 GB8.8 / 6 GB—✕ Won't fit
CMF Phone 2 ProDimensity 7300 · 8 GB8.8 / 6 GB—✕ Won't fit
AQUOS sense10Snapdragon 7s Gen 3 · 8 GB8.8 / 6 GB—✕ Won't fit
AQUOS sense9Snapdragon 7s Gen 2 · 8 GB8.8 / 6 GB—✕ Won't fit
Xperia 10 VIISnapdragon 6 Gen 3 · 8 GB8.8 / 6 GB—✕ Won't fit
Galaxy Z Flip5Snapdragon 8 Gen 2 · 8 GB8.8 / 6 GB—✕ Won't fit
Redmi Note 17Snapdragon 4 Gen 4 · 8 GB8.8 / 6 GB—✕ Won't fit
vivo S2Dimensity 7360-Turbo · 8 GB8.8 / 6 GB—✕ Won't fit
vivo V80 Lite 5G (Pakistan)Dimensity 7360-Turbo · 8 GB8.8 / 6 GB—✕ Won't fit
iQOO Z11 LiteDimensity 6300 · 8 GB8.8 / 6 GB—✕ Won't fit
iPhone 16 Pro MaxApple A18 Pro · 8 GB8.8 / 5.2 GB—✕ Won't fit
iPhone 16 ProApple A18 Pro · 8 GB8.8 / 5.2 GB—✕ Won't fit
iPhone 16Apple A18 · 8 GB8.8 / 5.2 GB—✕ Won't fit
iPhone 15 ProApple A17 Pro · 8 GB8.8 / 5.2 GB—✕ Won't fit
iPhone 17Apple A19 · 8 GB8.8 / 5.2 GB—✕ Won't fit
iPhone 16eApple A18 · 8 GB8.8 / 5.2 GB—✕ Won't fit
iPhone 17eApple A19 · 8 GB8.8 / 5.2 GB—✕ Won't fit
iPhone 15Apple A16 Bionic · 6 GB8.8 / 3.9 GB—✕ Won't fit
iPhone 14Apple A15 Bionic · 6 GB8.8 / 3.9 GB—✕ Won't fit
Moto G (2026)Dimensity 6300 · 4 GB8.8 / 2 GB—✕ Won't fit

~ = bandwidth-based estimate · ✓ = measured on real hardware

Gemma 4 12B on 54 Mac configurations

Each Mac uses the recommended Q4_0 at 4K context when it fits, or the largest smaller tracked quant that fits. Each row links to the full report with a macOS-specific setup guide.

MacUnified memoryQuantWorking budgetNeedsEstimated speedVerdict
Mac Studio M5 Ultra512 GBQ4_0504 GB9 GB~85.7–120 tokens/s✓ Runs great
Mac Studio M3 Ultra512 GBQ4_0504 GB9 GB~58.5–81.9 tokens/s✓ Runs great
Mac Studio M5 Ultra256 GBQ4_0248 GB9 GB~85.7–120 tokens/s✓ Runs great
Mac Studio M3 Ultra256 GBQ4_0248 GB9 GB~58.5–81.9 tokens/s✓ Runs great
Mac Studio M5 Max128 GBQ4_0120 GB9 GB~43.9–61.4 tokens/s✓ Runs great
MacBook Pro M5 Max128 GBQ4_0120 GB9 GB~43.9–61.4 tokens/s✓ Runs great
Mac Studio M4 Max128 GBQ4_0120 GB9 GB~39–54.6 tokens/s✓ Runs great
MacBook Pro M4 Max128 GBQ4_0120 GB9 GB~39–54.6 tokens/s✓ Runs great
MacBook Pro M3 Max128 GBQ4_0120 GB9 GB~28.6–40 tokens/s✓ Runs great
Mac Studio M5 Ultra96 GBQ4_088 GB9 GB~85.7–120 tokens/s✓ Runs great
Mac Studio M3 Ultra96 GBQ4_088 GB9 GB~58.5–81.9 tokens/s✓ Runs great
Mac mini M5 Pro64 GBQ4_057.6 GB9 GB~21.9–30.7 tokens/s✓ Runs great
Mac Studio M5 Max64 GBQ4_057.6 GB9 GB~43.9–61.4 tokens/s✓ Runs great
MacBook Pro M5 Pro64 GBQ4_057.6 GB9 GB~21.9–30.7 tokens/s✓ Runs great
MacBook Pro M5 Max64 GBQ4_057.6 GB9 GB~43.9–61.4 tokens/s✓ Runs great
Mac Studio M4 Max64 GBQ4_057.6 GB9 GB~39–54.6 tokens/s✓ Runs great
Mac mini M4 Pro64 GBQ4_057.6 GB9 GB~19.5–27.3 tokens/s✓ Runs great
MacBook Pro M4 Max64 GBQ4_057.6 GB9 GB~39–54.6 tokens/s✓ Runs great
MacBook Pro M3 Max64 GBQ4_057.6 GB9 GB~28.6–40 tokens/s✓ Runs great
Mac mini M5 Pro48 GBQ4_043.2 GB9 GB~21.9–30.7 tokens/s✓ Runs great
Mac Studio M5 Max48 GBQ4_043.2 GB9 GB~43.9–61.4 tokens/s✓ Runs great
MacBook Pro M5 Pro48 GBQ4_043.2 GB9 GB~21.9–30.7 tokens/s✓ Runs great
Mac Studio M4 Max48 GBQ4_043.2 GB9 GB~39–54.6 tokens/s✓ Runs great
Mac mini M4 Pro48 GBQ4_043.2 GB9 GB~19.5–27.3 tokens/s✓ Runs great
MacBook Pro M4 Pro48 GBQ4_043.2 GB9 GB~19.5–27.3 tokens/s✓ Runs great
Mac Studio M5 Max36 GBQ4_032.4 GB9 GB~32.9–46 tokens/s✓ Runs great
MacBook Pro M5 Max36 GBQ4_032.4 GB9 GB~32.9–46 tokens/s✓ Runs great
Mac Studio M4 Max36 GBQ4_032.4 GB9 GB~29.3–41 tokens/s✓ Runs great
MacBook Pro M4 Max36 GBQ4_032.4 GB9 GB~29.3–41 tokens/s✓ Runs great
MacBook Pro M3 Pro36 GBQ4_032.4 GB9 GB~10.7–15 tokens/s✓ Runs great
MacBook Pro M3 Max36 GBQ4_032.4 GB9 GB~21.4–30 tokens/s✓ Runs great
Mac mini M632 GBQ4_028.8 GB9 GB~12.1–17 tokens/s✓ Runs great
Mac mini M5 Pro32 GBQ4_028.8 GB9 GB~21.9–30.7 tokens/s✓ Runs great
MacBook Air M532 GBQ4_028.8 GB9 GB~9.2–12.7 tokens/s✓ Runs great
MacBook Air M432 GBQ4_028.8 GB9 GB~7.2–9.9 tokens/s✓ Runs great
Mac mini M432 GBQ4_028.8 GB9 GB~8.6–12 tokens/s✓ Runs great
Mac mini M624 GBQ4_021 GB9 GB~12.1–17 tokens/s✓ Runs great
Mac mini M5 Pro24 GBQ4_021 GB9 GB~21.9–30.7 tokens/s✓ Runs great
MacBook Air M524 GBQ4_021 GB9 GB~9.2–12.7 tokens/s✓ Runs great
MacBook Pro M5 Pro24 GBQ4_021 GB9 GB~21.9–30.7 tokens/s✓ Runs great
MacBook Air M424 GBQ4_021 GB9 GB~7.2–9.9 tokens/s✓ Runs great
Mac mini M424 GBQ4_021 GB9 GB~8.6–12 tokens/s✓ Runs great
Mac mini M4 Pro24 GBQ4_021 GB9 GB~19.5–27.3 tokens/s✓ Runs great
MacBook Air M324 GBQ4_021 GB9 GB~6–8.3 tokens/s✓ Runs great
MacBook Pro M4 Pro24 GBQ4_021 GB9 GB~19.5–27.3 tokens/s✓ Runs great
MacBook Pro M3 Pro18 GBQ4_015 GB9 GB~10.7–15 tokens/s✓ Runs great
Mac mini M616 GBQ4_013 GB9 GB~12.1–17 tokens/s✓ Runs great
MacBook Air M516 GBQ4_013 GB9 GB~9.2–12.7 tokens/s✓ Runs great
MacBook Air M416 GBQ4_013 GB9 GB~7.2–9.9 tokens/s✓ Runs great
Mac mini M416 GBQ4_013 GB9 GB~8.6–12 tokens/s✓ Runs great
MacBook Air M316 GBQ4_013 GB9 GB~6–8.3 tokens/s✓ Runs great
MacBook Air M116 GBQ4_013 GB9 GB~4.1–5.7 tokens/s✓ Runs great
MacBook Neo A18 Pro8 GBQ4_05 GB9 GB—✕ Won't fit
MacBook Air M18 GBQ4_05 GB9 GB—✕ Won't fit

FAQ

How much RAM do I need to run Gemma 4 12B on a phone?

At Q4_0, Gemma 4 12B needs ~8.8GB of usable memory (weights + KV cache + runtime). In practice that means a 12GB+ Android phone or a 16GB+ iPhone — iOS lets a single app use less of its RAM than Android does.

How fast does Gemma 4 12B run on a flagship phone?

On the OPPO Find X8 Pro (Dimensity 9400) it runs at ~5.5 tokens/s at Q4_0, estimated from memory bandwidth. Anything above ~8 tokens/s feels smooth for chat.

Can an iPhone run Gemma 4 12B?

Not really: the best iPhone we track (iPhone Air) has ~7.8GB usable, but Gemma 4 12B needs 8.8GB at Q4_0.

What is the best quantization of Gemma 4 12B for mobile?

Q4_0 (7GB download) is the size/quality sweet spot. Total memory needed is ~8.8GB once the KV cache and runtime are counted — the download size alone understates it.

How many phones can run Gemma 4 12B?

102 of the 140 phones we track have enough estimated usable memory at Q4_0; 86 also reach our usable-speed threshold of 3 tokens/s, and 0 run smoothly. Memory-fit alone does not mean a good experience.

Which Macs can run Gemma 4 12B?

52 of the 54 exact Mac configurations we track have enough estimated working memory. Each Mac uses the recommended Q4_0 when it fits, or the largest smaller tracked quant that fits, and separates installed unified memory, the macOS reserve, and estimated speed.

What is Gemma 4 12B good for on a phone?

It's tagged for chat, vision, reasoning. At 12B parameters, it prioritizes answer quality over speed — expect slower decoding.

Similar models

Gemma 3 1BGemma 3 4BGemma 3 12BGemma 4 E2BGemma 4 E4B