Granite 4.2 30B

At the default Q4_K_M, 0 of 139 phones have enough estimated usable memory; 0 also reach 3+ tokens/s. On Mac, 46 of 54 exact configurations pass using that quant or a smaller tracked fallback.

Params
30B
Family
granite
Released
2026-08
Tags
chat · coding · reasoning

Downloads & memory by quant

The download is only the weights — add KV cache and runtime to get what your phone actually needs. “Memory-fit” only means it can load; “usable” also requires an estimated 3+ tokens/s. Each row uses that row's quant. ★ = recommended.

QuantDownloadMemory neededPhone reality
Q2_K10.9 GB~14.1 GB4 memory-fit · 4 usable
Q3_K_M14.1 GB~17.5 GB3 memory-fit · 0 usable
Q4_016.6 GB~20.1 GB0 memory-fit
Q4_K_S16.7 GB~20.2 GB0 memory-fit
Q4_K_M17.7 GB~21.3 GB0 memory-fit
Q5_K_M20.8 GB~24.5 GB0 memory-fit
Q6_K24 GB~27.9 GB0 memory-fit
Q8_031.1 GB~35.4 GB0 memory-fit

Granite 4.2 30B at Q4_K_M on 139 phones

This table is fixed to the recommended Q4_K_M, on each phone's largest RAM option. Counts for smaller quants above will differ. All phones are shown, sorted by fit and estimated experience; tap one for the full report.

PhoneChip · RAMNeedsSpeedVerdict

~ = bandwidth-based estimate · ✓ = measured on real hardware

Granite 4.2 30B on 54 Mac configurations

Each Mac uses the recommended Q4_K_M at 4K context when it fits, or the largest smaller tracked quant that fits. Each row links to the full report with a macOS-specific setup guide.

MacUnified memoryQuantWorking budgetNeedsEstimated speedVerdict

FAQ

How much RAM do I need to run Granite 4.2 30B on a phone?

At Q4_K_M, Granite 4.2 30B needs ~21.3GB of usable memory (weights + KV cache + runtime). In practice that means no current Android phone or no current iPhone — iOS lets a single app use less of its RAM than Android does.

How fast does Granite 4.2 30B run on a flagship phone?

It doesn't fit on any of the 139 phones we track at Q4_K_M — it needs ~21.3GB of usable memory.

Can an iPhone run Granite 4.2 30B?

Not really: the best iPhone we track (iPhone 16 Pro Max) has ~5.2GB usable, but Granite 4.2 30B needs 21.3GB at Q4_K_M.

What is the best quantization of Granite 4.2 30B for mobile?

Q4_K_M (17.7GB download) is the size/quality sweet spot of the 8 quants available. Total memory needed is ~21.3GB once the KV cache and runtime are counted — the download size alone understates it.

How many phones can run Granite 4.2 30B?

0 of the 139 phones we track have enough estimated usable memory at Q4_K_M; 0 also reach our usable-speed threshold of 3 tokens/s, and 0 run smoothly. Memory-fit alone does not mean a good experience.

Which Macs can run Granite 4.2 30B?

46 of the 54 exact Mac configurations we track have enough estimated working memory. Each Mac uses the recommended Q4_K_M when it fits, or the largest smaller tracked quant that fits, and separates installed unified memory, the macOS reserve, and estimated speed.

What is Granite 4.2 30B good for on a phone?

It's tagged for chat, coding, reasoning. At 30B parameters, it prioritizes answer quality over speed — expect slower decoding.

Similar models

Granite 4.2 3BGranite 4.2 8BNemotron 3 Nano 30B-A3BNemotron 3.5 Lightning 30B-A3BSalience 1.5 Flash