aicanrun

Grug 12B

At the default Q4_K_M, 59 of 140 phones have enough estimated usable memory; 59 also reach 3+ tokens/s. On Mac, 52 of 54 exact configurations pass using that quant or a smaller tracked fallback.

Params
12B
Family
gemma
Released
2026-07
Tags
chat · vision · reasoning
Weights
kai-os_Grug-12B-GGUF ↗

Downloads & memory by quant

The download is only the weights — add KV cache and runtime to get what your phone actually needs. “Memory-fit” only means it can load; “usable” also requires an estimated 3+ tokens/s. Each row uses that row's quant. ★ = recommended.

QuantDownloadMemory neededPhone reality
Q2_K5.1 GB~6.8 GB105 memory-fit · 91 usable
Q3_K_M6.3 GB~8.1 GB102 memory-fit · 86 usable
IQ4_XS6.8 GB~8.6 GB102 memory-fit · 86 usable
Q4_07.1 GB~8.9 GB102 memory-fit · 86 usable
Q4_K_S7.2 GB~9 GB102 memory-fit · 86 usable
Q4_K_M ★7.7 GB~9.5 GB59 memory-fit · 59 usable
Q5_K_M8.8 GB~10.7 GB59 memory-fit · 59 usable
Q6_K10.2 GB~12.1 GB4 memory-fit · 4 usable
Q8_012.7 GB~14.8 GB4 memory-fit · 0 usable

Grug 12B at Q4_K_M on 140 phones

This table is fixed to the recommended Q4_K_M, on each phone's largest RAM option. Counts for smaller quants above will differ. All phones are shown, sorted by fit and estimated experience; tap one for the full report.

PhoneChip · RAMNeedsSpeedVerdict
OPPO Find X8 ProDimensity 9400 · 16 GB9.5 / 12 GB~5 tokens/s! Runs, barely
vivo X200 ProDimensity 9400 · 16 GB9.5 / 12 GB~5 tokens/s! Runs, barely
Galaxy S26 UltraSnapdragon 8 Elite Gen 5 · 16 GB9.5 / 12 GB~5 tokens/s! Runs, barely
Xiaomi 17Snapdragon 8 Elite Gen 5 · 16 GB9.5 / 12 GB~5 tokens/s! Runs, barely
Xiaomi 17 ProSnapdragon 8 Elite Gen 5 · 16 GB9.5 / 12 GB~5 tokens/s! Runs, barely
OnePlus 15Snapdragon 8 Elite Gen 5 · 16 GB9.5 / 12 GB~5 tokens/s! Runs, barely
vivo X300 ProDimensity 9500 · 16 GB9.5 / 12 GB~5 tokens/s! Runs, barely
OPPO Find X9 ProDimensity 9500 · 16 GB9.5 / 12 GB~5 tokens/s! Runs, barely
RedMagic 11S ProSnapdragon 8 Elite Gen 5 · 16 GB9.5 / 12 GB~5 tokens/s! Runs, barely
Honor Magic8 ProSnapdragon 8 Elite Gen 5 · 16 GB9.5 / 12 GB~5 tokens/s! Runs, barely
Xperia 1 VIIISnapdragon 8 Elite Gen 5 · 16 GB9.5 / 12 GB~5 tokens/s! Runs, barely
Galaxy Z Fold8Snapdragon 8 Elite Gen 5 · 16 GB9.5 / 12 GB~5 tokens/s! Runs, barely
Galaxy Z Fold8 UltraSnapdragon 8 Elite Gen 5 · 16 GB9.5 / 12 GB~5 tokens/s! Runs, barely
Honor Magic V6Snapdragon 8 Elite Gen 5 · 16 GB9.5 / 12 GB~5 tokens/s! Runs, barely
HONOR Robot PhoneSnapdragon 8 Elite Gen 5 · 16 GB9.5 / 12 GB~5 tokens/s! Runs, barely
OPPO Find N6Snapdragon 8 Elite Gen 5 · 16 GB9.5 / 12 GB~5 tokens/s! Runs, barely
vivo X Fold6Dimensity 9500 · 16 GB9.5 / 12 GB~5 tokens/s! Runs, barely
Galaxy S25 UltraSnapdragon 8 Elite · 16 GB9.5 / 12 GB~4.5 tokens/s! Runs, barely
OnePlus 13Snapdragon 8 Elite · 24 GB9.5 / 20 GB~4.5 tokens/s! Runs, barely
OnePlus 12Snapdragon 8 Gen 3 · 24 GB9.5 / 20 GB~4.5 tokens/s! Runs, barely
Xiaomi 15 ProSnapdragon 8 Elite · 16 GB9.5 / 12 GB~4.5 tokens/s! Runs, barely
Xiaomi 14Snapdragon 8 Gen 3 · 16 GB9.5 / 12 GB~4.5 tokens/s! Runs, barely
vivo X100 ProDimensity 9300 · 16 GB9.5 / 12 GB~4.5 tokens/s! Runs, barely
ROG Phone 9 ProSnapdragon 8 Elite · 24 GB9.5 / 20 GB~4.5 tokens/s! Runs, barely
Nothing Phone (3)Snapdragon 8s Gen 4 · 16 GB9.5 / 12 GB~4.5 tokens/s! Runs, barely
HONOR Magic7 ProSnapdragon 8 Elite · 16 GB9.5 / 12 GB~4.5 tokens/s! Runs, barely
Galaxy Z Fold7Snapdragon 8 Elite · 16 GB9.5 / 12 GB~4.5 tokens/s! Runs, barely
Motorola Razr Ultra (2025)Snapdragon 8 Elite · 16 GB9.5 / 12 GB~4.5 tokens/s! Runs, barely
OnePlus 13RSnapdragon 8 Gen 3 · 16 GB9.5 / 12 GB~4.5 tokens/s! Runs, barely
OnePlus 15RSnapdragon 8 Gen 5 · 16 GB9.5 / 12 GB~4.5 tokens/s! Runs, barely
Motorola Razr Ultra (2026)Snapdragon 8 Elite · 16 GB9.5 / 12 GB~4.5 tokens/s! Runs, barely
RedMagic 11 AirSnapdragon 8 Elite · 16 GB9.5 / 12 GB~4.5 tokens/s! Runs, barely
Xperia 1 VIISnapdragon 8 Elite · 16 GB9.5 / 12 GB~4.5 tokens/s! Runs, barely
Xiaomi MIX Fold 4Snapdragon 8 Gen 3 · 16 GB9.5 / 12 GB~4.5 tokens/s! Runs, barely
Xiaomi MIX FlipSnapdragon 8 Gen 3 · 16 GB9.5 / 12 GB~4.5 tokens/s! Runs, barely
Xiaomi MIX Flip 2Snapdragon 8 Elite · 16 GB9.5 / 12 GB~4.5 tokens/s! Runs, barely
Honor Magic V3Snapdragon 8 Gen 3 · 16 GB9.5 / 12 GB~4.5 tokens/s! Runs, barely
Honor Magic V5Snapdragon 8 Elite · 16 GB9.5 / 12 GB~4.5 tokens/s! Runs, barely
OPPO Find N5Snapdragon 8 Elite · 16 GB9.5 / 12 GB~4.5 tokens/s! Runs, barely
vivo X Fold3 ProSnapdragon 8 Gen 3 · 16 GB9.5 / 12 GB~4.5 tokens/s! Runs, barely
vivo X Fold5Snapdragon 8 Gen 3 · 16 GB9.5 / 12 GB~4.5 tokens/s! Runs, barely
Huawei Mate X7Kirin 9030 Pro · 20 GB9.5 / 16 GB~4.5 tokens/s! Runs, barely
Motorola Razr FoldSnapdragon 8 Gen 5 · 16 GB9.5 / 12 GB~4.5 tokens/s! Runs, barely
Pixel 9 ProGoogle Tensor G4 · 16 GB9.5 / 12 GB~4 tokens/s! Runs, barely
Pixel 10 ProGoogle Tensor G5 · 16 GB9.5 / 12 GB~4 tokens/s! Runs, barely
Pixel 11 ProGoogle Tensor G6 · 16 GB9.5 / 12 GB~4 tokens/s! Runs, barely
Pixel 11 Pro XLGoogle Tensor G6 · 16 GB9.5 / 12 GB~4 tokens/s! Runs, barely
Pixel 9 Pro XLGoogle Tensor G4 · 16 GB9.5 / 12 GB~4 tokens/s! Runs, barely
Pixel 10 Pro XLGoogle Tensor G5 · 16 GB9.5 / 12 GB~4 tokens/s! Runs, barely
Pixel 9 Pro FoldGoogle Tensor G4 · 16 GB9.5 / 12 GB~4 tokens/s! Runs, barely
Pixel 10 Pro FoldGoogle Tensor G5 · 16 GB9.5 / 12 GB~4 tokens/s! Runs, barely
Pixel 11 Pro FoldGoogle Tensor G6 · 16 GB9.5 / 12 GB~4 tokens/s! Runs, barely
Huawei Mate X6Kirin 9020 · 16 GB9.5 / 12 GB~4 tokens/s! Runs, barely
Motorola Edge 50 UltraSnapdragon 8s Gen 3 · 16 GB9.5 / 12 GB~3.9 tokens/s! Runs, barely
Xiaomi MIX Fold 3Snapdragon 8 Gen 2 · 16 GB9.5 / 12 GB~3.9 tokens/s! Runs, barely
Honor Magic V2Snapdragon 8 Gen 2 · 16 GB9.5 / 12 GB~3.9 tokens/s! Runs, barely
OPPO Find N3Snapdragon 8 Gen 2 · 16 GB9.5 / 12 GB~3.9 tokens/s! Runs, barely
OnePlus OpenSnapdragon 8 Gen 2 · 16 GB9.5 / 12 GB~3.9 tokens/s! Runs, barely
vivo X Fold3Snapdragon 8 Gen 2 · 16 GB9.5 / 12 GB~3.9 tokens/s! Runs, barely
Galaxy S25Snapdragon 8 Elite · 12 GB9.5 / 9 GB—✕ Won't fit
Galaxy S24 UltraSnapdragon 8 Gen 3 · 12 GB9.5 / 9 GB—✕ Won't fit
Galaxy S24Samsung Exynos 2400 · 12 GB9.5 / 9 GB—✕ Won't fit
Galaxy S23 UltraSnapdragon 8 Gen 2 · 12 GB9.5 / 9 GB—✕ Won't fit
Galaxy A55Exynos 1480 · 12 GB9.5 / 9 GB—✕ Won't fit
Pixel 9Google Tensor G4 · 12 GB9.5 / 9 GB—✕ Won't fit
Pixel 8 ProGoogle Tensor G3 · 12 GB9.5 / 9 GB—✕ Won't fit
Redmi Note 13 ProSnapdragon 7s Gen 2 · 12 GB9.5 / 9 GB—✕ Won't fit
POCO X6 ProDimensity 8300 Ultra · 12 GB9.5 / 9 GB—✕ Won't fit
Nothing Phone (2a)Dimensity 7200 Pro · 12 GB9.5 / 9 GB—✕ Won't fit
Galaxy S26Snapdragon 8 Elite Gen 5 · 12 GB9.5 / 9 GB—✕ Won't fit
Galaxy S26+Snapdragon 8 Elite Gen 5 · 12 GB9.5 / 9 GB—✕ Won't fit
vivo X300 ESnapdragon 8 Gen 5 · 12 GB9.5 / 9 GB—✕ Won't fit
Pixel 10Google Tensor G5 · 12 GB9.5 / 9 GB—✕ Won't fit
Pixel 11Google Tensor G6 · 12 GB9.5 / 9 GB—✕ Won't fit
Nothing Phone (3a)Snapdragon 7s Gen 3 · 12 GB9.5 / 9 GB—✕ Won't fit
Galaxy A36 5GSnapdragon 6 Gen 3 · 12 GB9.5 / 9 GB—✕ Won't fit
Galaxy A56 5GExynos 1580 · 12 GB9.5 / 9 GB—✕ Won't fit
Galaxy Z Fold6Snapdragon 8 Gen 3 · 12 GB9.5 / 9 GB—✕ Won't fit
Galaxy Z Flip6Snapdragon 8 Gen 3 · 12 GB9.5 / 9 GB—✕ Won't fit
Galaxy Z Flip7Exynos 2500 · 12 GB9.5 / 9 GB—✕ Won't fit
Galaxy A57 5GExynos 1680 · 12 GB9.5 / 9 GB—✕ Won't fit
Galaxy A37 5GExynos 1480 · 12 GB9.5 / 9 GB—✕ Won't fit
Motorola Razr+ (2026)Snapdragon 8s Gen 3 · 12 GB9.5 / 9 GB—✕ Won't fit
Nothing Phone (4a) ProSnapdragon 7 Gen 4 · 12 GB9.5 / 9 GB—✕ Won't fit
Redmi Note 14 Pro 5GDimensity 7300 · 12 GB9.5 / 9 GB—✕ Won't fit
Redmi Note 15 Pro 5GDimensity 7400 Ultra · 12 GB9.5 / 9 GB—✕ Won't fit
Redmi Note 15 5GSnapdragon 6 Gen 3 · 12 GB9.5 / 9 GB—✕ Won't fit
Redmi Note 14 Pro+ 5GSnapdragon 7s Gen 3 · 12 GB9.5 / 9 GB—✕ Won't fit
Redmi Note 15 Pro+ 5GSnapdragon 7s Gen 4 · 12 GB9.5 / 9 GB—✕ Won't fit
Xiaomi 15TDimensity 8400 Ultra · 12 GB9.5 / 9 GB—✕ Won't fit
Xiaomi 15T ProDimensity 9400+ · 12 GB9.5 / 9 GB—✕ Won't fit
POCO X7 ProDimensity 8400 Ultra · 12 GB9.5 / 9 GB—✕ Won't fit
Xiaomi MIX Fold 2Snapdragon 8+ Gen 1 · 12 GB9.5 / 9 GB—✕ Won't fit
Honor 400Snapdragon 7 Gen 3 · 12 GB9.5 / 9 GB—✕ Won't fit
AQUOS R10Snapdragon 7+ Gen 3 · 12 GB9.5 / 9 GB—✕ Won't fit
Galaxy Z Flip8Samsung Exynos 2600 · 12 GB9.5 / 9 GB—✕ Won't fit
Galaxy Z Fold5Snapdragon 8 Gen 2 · 12 GB9.5 / 9 GB—✕ Won't fit
Pixel FoldTensor G2 · 12 GB9.5 / 9 GB—✕ Won't fit
Motorola Razr+ (2023)Snapdragon 8+ Gen 1 · 12 GB9.5 / 9 GB—✕ Won't fit
Motorola Razr (2024)Dimensity 7300X · 12 GB9.5 / 9 GB—✕ Won't fit
Motorola Razr+ (2024)Snapdragon 8s Gen 3 · 12 GB9.5 / 9 GB—✕ Won't fit
Motorola Razr+ (2025)Snapdragon 8s Gen 3 · 12 GB9.5 / 9 GB—✕ Won't fit
iPhone AirApple A19 Pro · 12 GB9.5 / 7.8 GB—✕ Won't fit
iPhone 17 ProApple A19 Pro · 12 GB9.5 / 7.8 GB—✕ Won't fit
iPhone 17 Pro MaxApple A19 Pro · 12 GB9.5 / 7.8 GB—✕ Won't fit
Pixel 8aGoogle Tensor G3 · 8 GB9.5 / 6 GB—✕ Won't fit
Galaxy S26 FEExynos 2500 · 8 GB9.5 / 6 GB—✕ Won't fit
Pixel 9aGoogle Tensor G4 · 8 GB9.5 / 6 GB—✕ Won't fit
Galaxy S25 FESamsung Exynos 2400 · 8 GB9.5 / 6 GB—✕ Won't fit
Galaxy A16 5GExynos 1330 · 8 GB9.5 / 6 GB—✕ Won't fit
Galaxy A17 5GExynos 1330 · 8 GB9.5 / 6 GB—✕ Won't fit
Galaxy A26 5GExynos 1380 · 8 GB9.5 / 6 GB—✕ Won't fit
Moto G (2025)Dimensity 6300 · 8 GB9.5 / 6 GB—✕ Won't fit
Moto G Power (2025)Dimensity 6300 · 8 GB9.5 / 6 GB—✕ Won't fit
Moto G Stylus (2025)Snapdragon 6 Gen 3 · 8 GB9.5 / 6 GB—✕ Won't fit
Moto G Power (2026)Dimensity 6300 · 8 GB9.5 / 6 GB—✕ Won't fit
Moto G Stylus (2026)Snapdragon 6 Gen 3 · 8 GB9.5 / 6 GB—✕ Won't fit
Motorola Razr (2025)Dimensity 7400X · 8 GB9.5 / 6 GB—✕ Won't fit
Pixel 10aGoogle Tensor G4 · 8 GB9.5 / 6 GB—✕ Won't fit
Motorola Razr (2026)Dimensity 7450X · 8 GB9.5 / 6 GB—✕ Won't fit
Motorola Edge (2026)Dimensity 7450 · 8 GB9.5 / 6 GB—✕ Won't fit
CMF Phone 2 ProDimensity 7300 · 8 GB9.5 / 6 GB—✕ Won't fit
AQUOS sense10Snapdragon 7s Gen 3 · 8 GB9.5 / 6 GB—✕ Won't fit
AQUOS sense9Snapdragon 7s Gen 2 · 8 GB9.5 / 6 GB—✕ Won't fit
Xperia 10 VIISnapdragon 6 Gen 3 · 8 GB9.5 / 6 GB—✕ Won't fit
Galaxy Z Flip5Snapdragon 8 Gen 2 · 8 GB9.5 / 6 GB—✕ Won't fit
Redmi Note 17Snapdragon 4 Gen 4 · 8 GB9.5 / 6 GB—✕ Won't fit
vivo S2Dimensity 7360-Turbo · 8 GB9.5 / 6 GB—✕ Won't fit
vivo V80 Lite 5G (Pakistan)Dimensity 7360-Turbo · 8 GB9.5 / 6 GB—✕ Won't fit
iQOO Z11 LiteDimensity 6300 · 8 GB9.5 / 6 GB—✕ Won't fit
iPhone 16 Pro MaxApple A18 Pro · 8 GB9.5 / 5.2 GB—✕ Won't fit
iPhone 16 ProApple A18 Pro · 8 GB9.5 / 5.2 GB—✕ Won't fit
iPhone 16Apple A18 · 8 GB9.5 / 5.2 GB—✕ Won't fit
iPhone 15 ProApple A17 Pro · 8 GB9.5 / 5.2 GB—✕ Won't fit
iPhone 17Apple A19 · 8 GB9.5 / 5.2 GB—✕ Won't fit
iPhone 16eApple A18 · 8 GB9.5 / 5.2 GB—✕ Won't fit
iPhone 17eApple A19 · 8 GB9.5 / 5.2 GB—✕ Won't fit
iPhone 15Apple A16 Bionic · 6 GB9.5 / 3.9 GB—✕ Won't fit
iPhone 14Apple A15 Bionic · 6 GB9.5 / 3.9 GB—✕ Won't fit
Moto G (2026)Dimensity 6300 · 4 GB9.5 / 2 GB—✕ Won't fit

~ = bandwidth-based estimate · ✓ = measured on real hardware

Grug 12B on 54 Mac configurations

Each Mac uses the recommended Q4_K_M at 4K context when it fits, or the largest smaller tracked quant that fits. Each row links to the full report with a macOS-specific setup guide.

MacUnified memoryQuantWorking budgetNeedsEstimated speedVerdict
Mac Studio M5 Ultra512 GBQ4_K_M504 GB9.7 GB~77.9–109.1 tokens/s✓ Runs great
Mac Studio M3 Ultra512 GBQ4_K_M504 GB9.7 GB~53.2–74.5 tokens/s✓ Runs great
Mac Studio M5 Ultra256 GBQ4_K_M248 GB9.7 GB~77.9–109.1 tokens/s✓ Runs great
Mac Studio M3 Ultra256 GBQ4_K_M248 GB9.7 GB~53.2–74.5 tokens/s✓ Runs great
Mac Studio M5 Max128 GBQ4_K_M120 GB9.7 GB~39.9–55.8 tokens/s✓ Runs great
MacBook Pro M5 Max128 GBQ4_K_M120 GB9.7 GB~39.9–55.8 tokens/s✓ Runs great
Mac Studio M4 Max128 GBQ4_K_M120 GB9.7 GB~35.5–49.6 tokens/s✓ Runs great
MacBook Pro M4 Max128 GBQ4_K_M120 GB9.7 GB~35.5–49.6 tokens/s✓ Runs great
MacBook Pro M3 Max128 GBQ4_K_M120 GB9.7 GB~26–36.4 tokens/s✓ Runs great
Mac Studio M5 Ultra96 GBQ4_K_M88 GB9.7 GB~77.9–109.1 tokens/s✓ Runs great
Mac Studio M3 Ultra96 GBQ4_K_M88 GB9.7 GB~53.2–74.5 tokens/s✓ Runs great
Mac mini M5 Pro64 GBQ4_K_M57.6 GB9.7 GB~19.9–27.9 tokens/s✓ Runs great
Mac Studio M5 Max64 GBQ4_K_M57.6 GB9.7 GB~39.9–55.8 tokens/s✓ Runs great
MacBook Pro M5 Pro64 GBQ4_K_M57.6 GB9.7 GB~19.9–27.9 tokens/s✓ Runs great
MacBook Pro M5 Max64 GBQ4_K_M57.6 GB9.7 GB~39.9–55.8 tokens/s✓ Runs great
Mac Studio M4 Max64 GBQ4_K_M57.6 GB9.7 GB~35.5–49.6 tokens/s✓ Runs great
Mac mini M4 Pro64 GBQ4_K_M57.6 GB9.7 GB~17.7–24.8 tokens/s✓ Runs great
MacBook Pro M4 Max64 GBQ4_K_M57.6 GB9.7 GB~35.5–49.6 tokens/s✓ Runs great
MacBook Pro M3 Max64 GBQ4_K_M57.6 GB9.7 GB~26–36.4 tokens/s✓ Runs great
Mac mini M5 Pro48 GBQ4_K_M43.2 GB9.7 GB~19.9–27.9 tokens/s✓ Runs great
Mac Studio M5 Max48 GBQ4_K_M43.2 GB9.7 GB~39.9–55.8 tokens/s✓ Runs great
MacBook Pro M5 Pro48 GBQ4_K_M43.2 GB9.7 GB~19.9–27.9 tokens/s✓ Runs great
Mac Studio M4 Max48 GBQ4_K_M43.2 GB9.7 GB~35.5–49.6 tokens/s✓ Runs great
Mac mini M4 Pro48 GBQ4_K_M43.2 GB9.7 GB~17.7–24.8 tokens/s✓ Runs great
MacBook Pro M4 Pro48 GBQ4_K_M43.2 GB9.7 GB~17.7–24.8 tokens/s✓ Runs great
Mac Studio M5 Max36 GBQ4_K_M32.4 GB9.7 GB~29.9–41.8 tokens/s✓ Runs great
MacBook Pro M5 Max36 GBQ4_K_M32.4 GB9.7 GB~29.9–41.8 tokens/s✓ Runs great
Mac Studio M4 Max36 GBQ4_K_M32.4 GB9.7 GB~26.6–37.3 tokens/s✓ Runs great
MacBook Pro M4 Max36 GBQ4_K_M32.4 GB9.7 GB~26.6–37.3 tokens/s✓ Runs great
MacBook Pro M3 Pro36 GBQ4_K_M32.4 GB9.7 GB~9.7–13.6 tokens/s✓ Runs great
MacBook Pro M3 Max36 GBQ4_K_M32.4 GB9.7 GB~19.5–27.3 tokens/s✓ Runs great
Mac mini M632 GBQ4_K_M28.8 GB9.7 GB~11–15.5 tokens/s✓ Runs great
Mac mini M5 Pro32 GBQ4_K_M28.8 GB9.7 GB~19.9–27.9 tokens/s✓ Runs great
MacBook Air M532 GBQ4_K_M28.8 GB9.7 GB~8.3–11.5 tokens/s✓ Runs great
MacBook Air M432 GBQ4_K_M28.8 GB9.7 GB~6.5–9 tokens/s✓ Runs great
Mac mini M432 GBQ4_K_M28.8 GB9.7 GB~7.8–10.9 tokens/s✓ Runs great
Mac mini M624 GBQ4_K_M21 GB9.7 GB~11–15.5 tokens/s✓ Runs great
Mac mini M5 Pro24 GBQ4_K_M21 GB9.7 GB~19.9–27.9 tokens/s✓ Runs great
MacBook Air M524 GBQ4_K_M21 GB9.7 GB~8.3–11.5 tokens/s✓ Runs great
MacBook Pro M5 Pro24 GBQ4_K_M21 GB9.7 GB~19.9–27.9 tokens/s✓ Runs great
MacBook Air M424 GBQ4_K_M21 GB9.7 GB~6.5–9 tokens/s✓ Runs great
Mac mini M424 GBQ4_K_M21 GB9.7 GB~7.8–10.9 tokens/s✓ Runs great
Mac mini M4 Pro24 GBQ4_K_M21 GB9.7 GB~17.7–24.8 tokens/s✓ Runs great
MacBook Air M324 GBQ4_K_M21 GB9.7 GB~5.5–7.5 tokens/s✓ Runs great
MacBook Pro M4 Pro24 GBQ4_K_M21 GB9.7 GB~17.7–24.8 tokens/s✓ Runs great
MacBook Pro M3 Pro18 GBQ4_K_M15 GB9.7 GB~9.7–13.6 tokens/s✓ Runs great
Mac mini M616 GBQ4_K_M13 GB9.7 GB~11–15.5 tokens/s✓ Runs great
MacBook Air M516 GBQ4_K_M13 GB9.7 GB~8.3–11.5 tokens/s✓ Runs great
MacBook Air M416 GBQ4_K_M13 GB9.7 GB~6.5–9 tokens/s✓ Runs great
Mac mini M416 GBQ4_K_M13 GB9.7 GB~7.8–10.9 tokens/s✓ Runs great
MacBook Air M316 GBQ4_K_M13 GB9.7 GB~5.5–7.5 tokens/s✓ Runs great
MacBook Air M116 GBQ4_K_M13 GB9.7 GB~3.7–5.1 tokens/s✓ Runs great
MacBook Neo A18 Pro8 GBQ4_K_M5 GB9.7 GB—✕ Won't fit
MacBook Air M18 GBQ4_K_M5 GB9.7 GB—✕ Won't fit

FAQ

How much RAM do I need to run Grug 12B on a phone?

At Q4_K_M, Grug 12B needs ~9.5GB of usable memory (weights + KV cache + runtime). In practice that means a 16GB+ Android phone or a 16GB+ iPhone — iOS lets a single app use less of its RAM than Android does.

How fast does Grug 12B run on a flagship phone?

On the OPPO Find X8 Pro (Dimensity 9400) it runs at ~5 tokens/s at Q4_K_M, estimated from memory bandwidth. Anything above ~8 tokens/s feels smooth for chat.

Can an iPhone run Grug 12B?

Not really: the best iPhone we track (iPhone Air) has ~7.8GB usable, but Grug 12B needs 9.5GB at Q4_K_M.

What is the best quantization of Grug 12B for mobile?

Q4_K_M (7.7GB download) is the size/quality sweet spot of the 9 quants available. Total memory needed is ~9.5GB once the KV cache and runtime are counted — the download size alone understates it.

How many phones can run Grug 12B?

59 of the 140 phones we track have enough estimated usable memory at Q4_K_M; 59 also reach our usable-speed threshold of 3 tokens/s, and 0 run smoothly. Memory-fit alone does not mean a good experience.

Which Macs can run Grug 12B?

52 of the 54 exact Mac configurations we track have enough estimated working memory. Each Mac uses the recommended Q4_K_M when it fits, or the largest smaller tracked quant that fits, and separates installed unified memory, the macOS reserve, and estimated speed.

What is Grug 12B good for on a phone?

It's tagged for chat, vision, reasoning. At 12B parameters, it prioritizes answer quality over speed — expect slower decoding.

Similar models

Gemma 3 1BGemma 3 4BGemma 3 12BGemma 4 E2BGemma 4 E4B