aicanrun

Gemma 3 12B

At the default Q4_K_M, 59 of 140 phones have enough estimated usable memory; 59 also reach 3+ tokens/s. On Mac, 54 of 54 exact configurations pass using that quant or a smaller tracked fallback.

Params
12.2B
Family
gemma
Released
2025-03
Tags
chat · vision
Weights
gemma-3-12b-it-GGUF ↗

Downloads & memory by quant

The download is only the weights — add KV cache and runtime to get what your phone actually needs. “Memory-fit” only means it can load; “usable” also requires an estimated 3+ tokens/s. Each row uses that row's quant. ★ = recommended.

QuantDownloadMemory neededPhone reality
IQ1_S3.1 GB~4.7 GB137 memory-fit · 125 usable
Q2_K4.8 GB~6.5 GB105 memory-fit · 91 usable
Q3_K_M6 GB~7.8 GB105 memory-fit · 89 usable
IQ4_XS6.6 GB~8.4 GB102 memory-fit · 86 usable
Q4_06.9 GB~8.7 GB102 memory-fit · 86 usable
Q4_K_S6.9 GB~8.7 GB102 memory-fit · 86 usable
Q4_K_M ★7.3 GB~9.1 GB59 memory-fit · 59 usable
Q5_K_M8.4 GB~10.3 GB59 memory-fit · 59 usable
Q6_K9.7 GB~11.6 GB59 memory-fit · 59 usable
Q8_012.5 GB~14.6 GB4 memory-fit · 0 usable

Gemma 3 12B at Q4_K_M on 140 phones

This table is fixed to the recommended Q4_K_M, on each phone's largest RAM option. Counts for smaller quants above will differ. All phones are shown, sorted by fit and estimated experience; tap one for the full report.

PhoneChip · RAMNeedsSpeedVerdict
OPPO Find X8 ProDimensity 9400 · 16 GB9.1 / 12 GB~5.3 tokens/s! Runs, barely
vivo X200 ProDimensity 9400 · 16 GB9.1 / 12 GB~5.3 tokens/s! Runs, barely
Galaxy S26 UltraSnapdragon 8 Elite Gen 5 · 16 GB9.1 / 12 GB~5.2 tokens/s! Runs, barely
Xiaomi 17Snapdragon 8 Elite Gen 5 · 16 GB9.1 / 12 GB~5.2 tokens/s! Runs, barely
Xiaomi 17 ProSnapdragon 8 Elite Gen 5 · 16 GB9.1 / 12 GB~5.2 tokens/s! Runs, barely
OnePlus 15Snapdragon 8 Elite Gen 5 · 16 GB9.1 / 12 GB~5.2 tokens/s! Runs, barely
vivo X300 ProDimensity 9500 · 16 GB9.1 / 12 GB~5.3 tokens/s! Runs, barely
OPPO Find X9 ProDimensity 9500 · 16 GB9.1 / 12 GB~5.3 tokens/s! Runs, barely
RedMagic 11S ProSnapdragon 8 Elite Gen 5 · 16 GB9.1 / 12 GB~5.2 tokens/s! Runs, barely
Honor Magic8 ProSnapdragon 8 Elite Gen 5 · 16 GB9.1 / 12 GB~5.2 tokens/s! Runs, barely
Xperia 1 VIIISnapdragon 8 Elite Gen 5 · 16 GB9.1 / 12 GB~5.2 tokens/s! Runs, barely
Galaxy Z Fold8Snapdragon 8 Elite Gen 5 · 16 GB9.1 / 12 GB~5.2 tokens/s! Runs, barely
Galaxy Z Fold8 UltraSnapdragon 8 Elite Gen 5 · 16 GB9.1 / 12 GB~5.2 tokens/s! Runs, barely
Honor Magic V6Snapdragon 8 Elite Gen 5 · 16 GB9.1 / 12 GB~5.2 tokens/s! Runs, barely
HONOR Robot PhoneSnapdragon 8 Elite Gen 5 · 16 GB9.1 / 12 GB~5.2 tokens/s! Runs, barely
OPPO Find N6Snapdragon 8 Elite Gen 5 · 16 GB9.1 / 12 GB~5.2 tokens/s! Runs, barely
vivo X Fold6Dimensity 9500 · 16 GB9.1 / 12 GB~5.3 tokens/s! Runs, barely
Galaxy S25 UltraSnapdragon 8 Elite · 16 GB9.1 / 12 GB~4.7 tokens/s! Runs, barely
OnePlus 13Snapdragon 8 Elite · 24 GB9.1 / 20 GB~4.7 tokens/s! Runs, barely
OnePlus 12Snapdragon 8 Gen 3 · 24 GB9.1 / 20 GB~4.7 tokens/s! Runs, barely
Xiaomi 15 ProSnapdragon 8 Elite · 16 GB9.1 / 12 GB~4.7 tokens/s! Runs, barely
Xiaomi 14Snapdragon 8 Gen 3 · 16 GB9.1 / 12 GB~4.7 tokens/s! Runs, barely
vivo X100 ProDimensity 9300 · 16 GB9.1 / 12 GB~4.7 tokens/s! Runs, barely
ROG Phone 9 ProSnapdragon 8 Elite · 24 GB9.1 / 20 GB~4.7 tokens/s! Runs, barely
Nothing Phone (3)Snapdragon 8s Gen 4 · 16 GB9.1 / 12 GB~4.7 tokens/s! Runs, barely
HONOR Magic7 ProSnapdragon 8 Elite · 16 GB9.1 / 12 GB~4.7 tokens/s! Runs, barely
Galaxy Z Fold7Snapdragon 8 Elite · 16 GB9.1 / 12 GB~4.7 tokens/s! Runs, barely
Motorola Razr Ultra (2025)Snapdragon 8 Elite · 16 GB9.1 / 12 GB~4.7 tokens/s! Runs, barely
OnePlus 13RSnapdragon 8 Gen 3 · 16 GB9.1 / 12 GB~4.7 tokens/s! Runs, barely
OnePlus 15RSnapdragon 8 Gen 5 · 16 GB9.1 / 12 GB~4.7 tokens/s! Runs, barely
Motorola Razr Ultra (2026)Snapdragon 8 Elite · 16 GB9.1 / 12 GB~4.7 tokens/s! Runs, barely
RedMagic 11 AirSnapdragon 8 Elite · 16 GB9.1 / 12 GB~4.7 tokens/s! Runs, barely
Xperia 1 VIISnapdragon 8 Elite · 16 GB9.1 / 12 GB~4.7 tokens/s! Runs, barely
Xiaomi MIX Fold 4Snapdragon 8 Gen 3 · 16 GB9.1 / 12 GB~4.7 tokens/s! Runs, barely
Xiaomi MIX FlipSnapdragon 8 Gen 3 · 16 GB9.1 / 12 GB~4.7 tokens/s! Runs, barely
Xiaomi MIX Flip 2Snapdragon 8 Elite · 16 GB9.1 / 12 GB~4.7 tokens/s! Runs, barely
Honor Magic V3Snapdragon 8 Gen 3 · 16 GB9.1 / 12 GB~4.7 tokens/s! Runs, barely
Honor Magic V5Snapdragon 8 Elite · 16 GB9.1 / 12 GB~4.7 tokens/s! Runs, barely
OPPO Find N5Snapdragon 8 Elite · 16 GB9.1 / 12 GB~4.7 tokens/s! Runs, barely
vivo X Fold3 ProSnapdragon 8 Gen 3 · 16 GB9.1 / 12 GB~4.7 tokens/s! Runs, barely
vivo X Fold5Snapdragon 8 Gen 3 · 16 GB9.1 / 12 GB~4.7 tokens/s! Runs, barely
Huawei Mate X7Kirin 9030 Pro · 20 GB9.1 / 16 GB~4.7 tokens/s! Runs, barely
Motorola Razr FoldSnapdragon 8 Gen 5 · 16 GB9.1 / 12 GB~4.7 tokens/s! Runs, barely
Pixel 9 ProGoogle Tensor G4 · 16 GB9.1 / 12 GB~4.2 tokens/s! Runs, barely
Motorola Edge 50 UltraSnapdragon 8s Gen 3 · 16 GB9.1 / 12 GB~4.1 tokens/s! Runs, barely
Pixel 10 ProGoogle Tensor G5 · 16 GB9.1 / 12 GB~4.2 tokens/s! Runs, barely
Pixel 11 ProGoogle Tensor G6 · 16 GB9.1 / 12 GB~4.2 tokens/s! Runs, barely
Pixel 11 Pro XLGoogle Tensor G6 · 16 GB9.1 / 12 GB~4.2 tokens/s! Runs, barely
Pixel 9 Pro XLGoogle Tensor G4 · 16 GB9.1 / 12 GB~4.2 tokens/s! Runs, barely
Pixel 10 Pro XLGoogle Tensor G5 · 16 GB9.1 / 12 GB~4.2 tokens/s! Runs, barely
Xiaomi MIX Fold 3Snapdragon 8 Gen 2 · 16 GB9.1 / 12 GB~4.1 tokens/s! Runs, barely
Honor Magic V2Snapdragon 8 Gen 2 · 16 GB9.1 / 12 GB~4.1 tokens/s! Runs, barely
OPPO Find N3Snapdragon 8 Gen 2 · 16 GB9.1 / 12 GB~4.1 tokens/s! Runs, barely
OnePlus OpenSnapdragon 8 Gen 2 · 16 GB9.1 / 12 GB~4.1 tokens/s! Runs, barely
vivo X Fold3Snapdragon 8 Gen 2 · 16 GB9.1 / 12 GB~4.1 tokens/s! Runs, barely
Pixel 9 Pro FoldGoogle Tensor G4 · 16 GB9.1 / 12 GB~4.2 tokens/s! Runs, barely
Pixel 10 Pro FoldGoogle Tensor G5 · 16 GB9.1 / 12 GB~4.2 tokens/s! Runs, barely
Pixel 11 Pro FoldGoogle Tensor G6 · 16 GB9.1 / 12 GB~4.2 tokens/s! Runs, barely
Huawei Mate X6Kirin 9020 · 16 GB9.1 / 12 GB~4.2 tokens/s! Runs, barely
Galaxy S25Snapdragon 8 Elite · 12 GB9.1 / 9 GB—✕ Won't fit
Galaxy S24 UltraSnapdragon 8 Gen 3 · 12 GB9.1 / 9 GB—✕ Won't fit
Galaxy S24Samsung Exynos 2400 · 12 GB9.1 / 9 GB—✕ Won't fit
Galaxy S23 UltraSnapdragon 8 Gen 2 · 12 GB9.1 / 9 GB—✕ Won't fit
Galaxy A55Exynos 1480 · 12 GB9.1 / 9 GB—✕ Won't fit
Pixel 9Google Tensor G4 · 12 GB9.1 / 9 GB—✕ Won't fit
Pixel 8 ProGoogle Tensor G3 · 12 GB9.1 / 9 GB—✕ Won't fit
Redmi Note 13 ProSnapdragon 7s Gen 2 · 12 GB9.1 / 9 GB—✕ Won't fit
POCO X6 ProDimensity 8300 Ultra · 12 GB9.1 / 9 GB—✕ Won't fit
Nothing Phone (2a)Dimensity 7200 Pro · 12 GB9.1 / 9 GB—✕ Won't fit
Galaxy S26Snapdragon 8 Elite Gen 5 · 12 GB9.1 / 9 GB—✕ Won't fit
Galaxy S26+Snapdragon 8 Elite Gen 5 · 12 GB9.1 / 9 GB—✕ Won't fit
vivo X300 ESnapdragon 8 Gen 5 · 12 GB9.1 / 9 GB—✕ Won't fit
Pixel 10Google Tensor G5 · 12 GB9.1 / 9 GB—✕ Won't fit
Pixel 11Google Tensor G6 · 12 GB9.1 / 9 GB—✕ Won't fit
Nothing Phone (3a)Snapdragon 7s Gen 3 · 12 GB9.1 / 9 GB—✕ Won't fit
Galaxy A36 5GSnapdragon 6 Gen 3 · 12 GB9.1 / 9 GB—✕ Won't fit
Galaxy A56 5GExynos 1580 · 12 GB9.1 / 9 GB—✕ Won't fit
Galaxy Z Fold6Snapdragon 8 Gen 3 · 12 GB9.1 / 9 GB—✕ Won't fit
Galaxy Z Flip6Snapdragon 8 Gen 3 · 12 GB9.1 / 9 GB—✕ Won't fit
Galaxy Z Flip7Exynos 2500 · 12 GB9.1 / 9 GB—✕ Won't fit
Galaxy A57 5GExynos 1680 · 12 GB9.1 / 9 GB—✕ Won't fit
Galaxy A37 5GExynos 1480 · 12 GB9.1 / 9 GB—✕ Won't fit
Motorola Razr+ (2026)Snapdragon 8s Gen 3 · 12 GB9.1 / 9 GB—✕ Won't fit
Nothing Phone (4a) ProSnapdragon 7 Gen 4 · 12 GB9.1 / 9 GB—✕ Won't fit
Redmi Note 14 Pro 5GDimensity 7300 · 12 GB9.1 / 9 GB—✕ Won't fit
Redmi Note 15 Pro 5GDimensity 7400 Ultra · 12 GB9.1 / 9 GB—✕ Won't fit
Redmi Note 15 5GSnapdragon 6 Gen 3 · 12 GB9.1 / 9 GB—✕ Won't fit
Redmi Note 14 Pro+ 5GSnapdragon 7s Gen 3 · 12 GB9.1 / 9 GB—✕ Won't fit
Redmi Note 15 Pro+ 5GSnapdragon 7s Gen 4 · 12 GB9.1 / 9 GB—✕ Won't fit
Xiaomi 15TDimensity 8400 Ultra · 12 GB9.1 / 9 GB—✕ Won't fit
Xiaomi 15T ProDimensity 9400+ · 12 GB9.1 / 9 GB—✕ Won't fit
POCO X7 ProDimensity 8400 Ultra · 12 GB9.1 / 9 GB—✕ Won't fit
Xiaomi MIX Fold 2Snapdragon 8+ Gen 1 · 12 GB9.1 / 9 GB—✕ Won't fit
Honor 400Snapdragon 7 Gen 3 · 12 GB9.1 / 9 GB—✕ Won't fit
AQUOS R10Snapdragon 7+ Gen 3 · 12 GB9.1 / 9 GB—✕ Won't fit
Galaxy Z Flip8Samsung Exynos 2600 · 12 GB9.1 / 9 GB—✕ Won't fit
Galaxy Z Fold5Snapdragon 8 Gen 2 · 12 GB9.1 / 9 GB—✕ Won't fit
Pixel FoldTensor G2 · 12 GB9.1 / 9 GB—✕ Won't fit
Motorola Razr+ (2023)Snapdragon 8+ Gen 1 · 12 GB9.1 / 9 GB—✕ Won't fit
Motorola Razr (2024)Dimensity 7300X · 12 GB9.1 / 9 GB—✕ Won't fit
Motorola Razr+ (2024)Snapdragon 8s Gen 3 · 12 GB9.1 / 9 GB—✕ Won't fit
Motorola Razr+ (2025)Snapdragon 8s Gen 3 · 12 GB9.1 / 9 GB—✕ Won't fit
iPhone AirApple A19 Pro · 12 GB9.1 / 7.8 GB—✕ Won't fit
iPhone 17 ProApple A19 Pro · 12 GB9.1 / 7.8 GB—✕ Won't fit
iPhone 17 Pro MaxApple A19 Pro · 12 GB9.1 / 7.8 GB—✕ Won't fit
Pixel 8aGoogle Tensor G3 · 8 GB9.1 / 6 GB—✕ Won't fit
Galaxy S26 FEExynos 2500 · 8 GB9.1 / 6 GB—✕ Won't fit
Pixel 9aGoogle Tensor G4 · 8 GB9.1 / 6 GB—✕ Won't fit
Galaxy S25 FESamsung Exynos 2400 · 8 GB9.1 / 6 GB—✕ Won't fit
Galaxy A16 5GExynos 1330 · 8 GB9.1 / 6 GB—✕ Won't fit
Galaxy A17 5GExynos 1330 · 8 GB9.1 / 6 GB—✕ Won't fit
Galaxy A26 5GExynos 1380 · 8 GB9.1 / 6 GB—✕ Won't fit
Moto G (2025)Dimensity 6300 · 8 GB9.1 / 6 GB—✕ Won't fit
Moto G Power (2025)Dimensity 6300 · 8 GB9.1 / 6 GB—✕ Won't fit
Moto G Stylus (2025)Snapdragon 6 Gen 3 · 8 GB9.1 / 6 GB—✕ Won't fit
Moto G Power (2026)Dimensity 6300 · 8 GB9.1 / 6 GB—✕ Won't fit
Moto G Stylus (2026)Snapdragon 6 Gen 3 · 8 GB9.1 / 6 GB—✕ Won't fit
Motorola Razr (2025)Dimensity 7400X · 8 GB9.1 / 6 GB—✕ Won't fit
Pixel 10aGoogle Tensor G4 · 8 GB9.1 / 6 GB—✕ Won't fit
Motorola Razr (2026)Dimensity 7450X · 8 GB9.1 / 6 GB—✕ Won't fit
Motorola Edge (2026)Dimensity 7450 · 8 GB9.1 / 6 GB—✕ Won't fit
CMF Phone 2 ProDimensity 7300 · 8 GB9.1 / 6 GB—✕ Won't fit
AQUOS sense10Snapdragon 7s Gen 3 · 8 GB9.1 / 6 GB—✕ Won't fit
AQUOS sense9Snapdragon 7s Gen 2 · 8 GB9.1 / 6 GB—✕ Won't fit
Xperia 10 VIISnapdragon 6 Gen 3 · 8 GB9.1 / 6 GB—✕ Won't fit
Galaxy Z Flip5Snapdragon 8 Gen 2 · 8 GB9.1 / 6 GB—✕ Won't fit
Redmi Note 17Snapdragon 4 Gen 4 · 8 GB9.1 / 6 GB—✕ Won't fit
vivo S2Dimensity 7360-Turbo · 8 GB9.1 / 6 GB—✕ Won't fit
vivo V80 Lite 5G (Pakistan)Dimensity 7360-Turbo · 8 GB9.1 / 6 GB—✕ Won't fit
iQOO Z11 LiteDimensity 6300 · 8 GB9.1 / 6 GB—✕ Won't fit
iPhone 16 Pro MaxApple A18 Pro · 8 GB9.1 / 5.2 GB—✕ Won't fit
iPhone 16 ProApple A18 Pro · 8 GB9.1 / 5.2 GB—✕ Won't fit
iPhone 16Apple A18 · 8 GB9.1 / 5.2 GB—✕ Won't fit
iPhone 15 ProApple A17 Pro · 8 GB9.1 / 5.2 GB—✕ Won't fit
iPhone 17Apple A19 · 8 GB9.1 / 5.2 GB—✕ Won't fit
iPhone 16eApple A18 · 8 GB9.1 / 5.2 GB—✕ Won't fit
iPhone 17eApple A19 · 8 GB9.1 / 5.2 GB—✕ Won't fit
iPhone 15Apple A16 Bionic · 6 GB9.1 / 3.9 GB—✕ Won't fit
iPhone 14Apple A15 Bionic · 6 GB9.1 / 3.9 GB—✕ Won't fit
Moto G (2026)Dimensity 6300 · 4 GB9.1 / 2 GB—✕ Won't fit

~ = bandwidth-based estimate · ✓ = measured on real hardware

Gemma 3 12B on 54 Mac configurations

Each Mac uses the recommended Q4_K_M at 4K context when it fits, or the largest smaller tracked quant that fits. Each row links to the full report with a macOS-specific setup guide.

MacUnified memoryQuantWorking budgetNeedsEstimated speedVerdict
Mac Studio M5 Ultra512 GBQ4_K_M504 GB9.3 GB~82.2–115.1 tokens/s✓ Runs great
Mac Studio M3 Ultra512 GBQ4_K_M504 GB9.3 GB~56.1–78.5 tokens/s✓ Runs great
Mac Studio M5 Ultra256 GBQ4_K_M248 GB9.3 GB~82.2–115.1 tokens/s✓ Runs great
Mac Studio M3 Ultra256 GBQ4_K_M248 GB9.3 GB~56.1–78.5 tokens/s✓ Runs great
Mac Studio M5 Max128 GBQ4_K_M120 GB9.3 GB~42.1–58.9 tokens/s✓ Runs great
MacBook Pro M5 Max128 GBQ4_K_M120 GB9.3 GB~42.1–58.9 tokens/s✓ Runs great
Mac Studio M4 Max128 GBQ4_K_M120 GB9.3 GB~37.4–52.4 tokens/s✓ Runs great
MacBook Pro M4 Max128 GBQ4_K_M120 GB9.3 GB~37.4–52.4 tokens/s✓ Runs great
MacBook Pro M3 Max128 GBQ4_K_M120 GB9.3 GB~27.4–38.4 tokens/s✓ Runs great
Mac Studio M5 Ultra96 GBQ4_K_M88 GB9.3 GB~82.2–115.1 tokens/s✓ Runs great
Mac Studio M3 Ultra96 GBQ4_K_M88 GB9.3 GB~56.1–78.5 tokens/s✓ Runs great
Mac mini M5 Pro64 GBQ4_K_M57.6 GB9.3 GB~21–29.4 tokens/s✓ Runs great
Mac Studio M5 Max64 GBQ4_K_M57.6 GB9.3 GB~42.1–58.9 tokens/s✓ Runs great
MacBook Pro M5 Pro64 GBQ4_K_M57.6 GB9.3 GB~21–29.4 tokens/s✓ Runs great
MacBook Pro M5 Max64 GBQ4_K_M57.6 GB9.3 GB~42.1–58.9 tokens/s✓ Runs great
Mac Studio M4 Max64 GBQ4_K_M57.6 GB9.3 GB~37.4–52.4 tokens/s✓ Runs great
Mac mini M4 Pro64 GBQ4_K_M57.6 GB9.3 GB~18.7–26.2 tokens/s✓ Runs great
MacBook Pro M4 Max64 GBQ4_K_M57.6 GB9.3 GB~37.4–52.4 tokens/s✓ Runs great
MacBook Pro M3 Max64 GBQ4_K_M57.6 GB9.3 GB~27.4–38.4 tokens/s✓ Runs great
Mac mini M5 Pro48 GBQ4_K_M43.2 GB9.3 GB~21–29.4 tokens/s✓ Runs great
Mac Studio M5 Max48 GBQ4_K_M43.2 GB9.3 GB~42.1–58.9 tokens/s✓ Runs great
MacBook Pro M5 Pro48 GBQ4_K_M43.2 GB9.3 GB~21–29.4 tokens/s✓ Runs great
Mac Studio M4 Max48 GBQ4_K_M43.2 GB9.3 GB~37.4–52.4 tokens/s✓ Runs great
Mac mini M4 Pro48 GBQ4_K_M43.2 GB9.3 GB~18.7–26.2 tokens/s✓ Runs great
MacBook Pro M4 Pro48 GBQ4_K_M43.2 GB9.3 GB~18.7–26.2 tokens/s✓ Runs great
Mac Studio M5 Max36 GBQ4_K_M32.4 GB9.3 GB~31.5–44.1 tokens/s✓ Runs great
MacBook Pro M5 Max36 GBQ4_K_M32.4 GB9.3 GB~31.5–44.1 tokens/s✓ Runs great
Mac Studio M4 Max36 GBQ4_K_M32.4 GB9.3 GB~28.1–39.3 tokens/s✓ Runs great
MacBook Pro M4 Max36 GBQ4_K_M32.4 GB9.3 GB~28.1–39.3 tokens/s✓ Runs great
MacBook Pro M3 Pro36 GBQ4_K_M32.4 GB9.3 GB~10.3–14.4 tokens/s✓ Runs great
MacBook Pro M3 Max36 GBQ4_K_M32.4 GB9.3 GB~20.5–28.8 tokens/s✓ Runs great
Mac mini M632 GBQ4_K_M28.8 GB9.3 GB~11.6–16.3 tokens/s✓ Runs great
Mac mini M5 Pro32 GBQ4_K_M28.8 GB9.3 GB~21–29.4 tokens/s✓ Runs great
MacBook Air M532 GBQ4_K_M28.8 GB9.3 GB~8.8–12.2 tokens/s✓ Runs great
MacBook Air M432 GBQ4_K_M28.8 GB9.3 GB~6.9–9.5 tokens/s✓ Runs great
Mac mini M432 GBQ4_K_M28.8 GB9.3 GB~8.2–11.5 tokens/s✓ Runs great
Mac mini M624 GBQ4_K_M21 GB9.3 GB~11.6–16.3 tokens/s✓ Runs great
Mac mini M5 Pro24 GBQ4_K_M21 GB9.3 GB~21–29.4 tokens/s✓ Runs great
MacBook Air M524 GBQ4_K_M21 GB9.3 GB~8.8–12.2 tokens/s✓ Runs great
MacBook Pro M5 Pro24 GBQ4_K_M21 GB9.3 GB~21–29.4 tokens/s✓ Runs great
MacBook Air M424 GBQ4_K_M21 GB9.3 GB~6.9–9.5 tokens/s✓ Runs great
Mac mini M424 GBQ4_K_M21 GB9.3 GB~8.2–11.5 tokens/s✓ Runs great
Mac mini M4 Pro24 GBQ4_K_M21 GB9.3 GB~18.7–26.2 tokens/s✓ Runs great
MacBook Air M324 GBQ4_K_M21 GB9.3 GB~5.8–7.9 tokens/s✓ Runs great
MacBook Pro M4 Pro24 GBQ4_K_M21 GB9.3 GB~18.7–26.2 tokens/s✓ Runs great
MacBook Pro M3 Pro18 GBQ4_K_M15 GB9.3 GB~10.3–14.4 tokens/s✓ Runs great
Mac mini M616 GBQ4_K_M13 GB9.3 GB~11.6–16.3 tokens/s✓ Runs great
MacBook Air M516 GBQ4_K_M13 GB9.3 GB~8.8–12.2 tokens/s✓ Runs great
MacBook Air M416 GBQ4_K_M13 GB9.3 GB~6.9–9.5 tokens/s✓ Runs great
Mac mini M416 GBQ4_K_M13 GB9.3 GB~8.2–11.5 tokens/s✓ Runs great
MacBook Air M316 GBQ4_K_M13 GB9.3 GB~5.8–7.9 tokens/s✓ Runs great
MacBook Air M116 GBQ4_K_M13 GB9.3 GB~3.9–5.4 tokens/s✓ Runs great
MacBook Neo A18 Pro8 GBIQ1_Ssmaller version5 GB4.9 GB~8.1–11.2 tokens/s! Runs, barely
MacBook Air M18 GBIQ1_Ssmaller version5 GB4.9 GB~9.3–12.8 tokens/s! Runs, barely

FAQ

How much RAM do I need to run Gemma 3 12B on a phone?

At Q4_K_M, Gemma 3 12B needs ~9.1GB of usable memory (weights + KV cache + runtime). In practice that means a 16GB+ Android phone or a 16GB+ iPhone — iOS lets a single app use less of its RAM than Android does.

How fast does Gemma 3 12B run on a flagship phone?

On the OPPO Find X8 Pro (Dimensity 9400) it runs at ~5.3 tokens/s at Q4_K_M, estimated from memory bandwidth. Anything above ~8 tokens/s feels smooth for chat.

Can an iPhone run Gemma 3 12B?

Not really: the best iPhone we track (iPhone Air) has ~7.8GB usable, but Gemma 3 12B needs 9.1GB at Q4_K_M.

What is the best quantization of Gemma 3 12B for mobile?

Q4_K_M (7.3GB download) is the size/quality sweet spot of the 10 quants available. Total memory needed is ~9.1GB once the KV cache and runtime are counted — the download size alone understates it.

How many phones can run Gemma 3 12B?

59 of the 140 phones we track have enough estimated usable memory at Q4_K_M; 59 also reach our usable-speed threshold of 3 tokens/s, and 0 run smoothly. Memory-fit alone does not mean a good experience.

Which Macs can run Gemma 3 12B?

54 of the 54 exact Mac configurations we track have enough estimated working memory. Each Mac uses the recommended Q4_K_M when it fits, or the largest smaller tracked quant that fits, and separates installed unified memory, the macOS reserve, and estimated speed.

What is Gemma 3 12B good for on a phone?

It's tagged for chat, vision. At 12.2B parameters, it prioritizes answer quality over speed — expect slower decoding.

Similar models

Gemma 3 1BGemma 3 4BGemma 4 E2BGemma 4 E4BGemma 4 12B