Granite 4.2 3B

At the default Q4_K_M, 138 of 139 phones have enough estimated usable memory; 138 also reach 3+ tokens/s. On Mac, 54 of 54 exact configurations pass using that quant or a smaller tracked fallback.

Params
3B
Family
granite
Released
2026-08
Tags
chat · coding · reasoning

Downloads & memory by quant

The download is only the weights — add KV cache and runtime to get what your phone actually needs. “Memory-fit” only means it can load; “usable” also requires an estimated 3+ tokens/s. Each row uses that row's quant. ★ = recommended.

QuantDownloadMemory neededPhone reality
Q2_K1.5 GB~2.4 GB138 memory-fit · 138 usable
Q3_K_M1.8 GB~2.7 GB138 memory-fit · 138 usable
Q4_02.1 GB~3 GB138 memory-fit · 138 usable
Q4_K_S2.1 GB~3 GB138 memory-fit · 138 usable
Q4_K_M2.2 GB~3.1 GB138 memory-fit · 138 usable
Q5_K_M2.6 GB~3.5 GB138 memory-fit · 138 usable
Q6_K3 GB~4 GB136 memory-fit · 125 usable
Q8_03.9 GB~4.9 GB136 memory-fit · 125 usable

Granite 4.2 3B at Q4_K_M on 139 phones

This table is fixed to the recommended Q4_K_M, on each phone's largest RAM option. Counts for smaller quants above will differ. All phones are shown, sorted by fit and estimated experience; tap one for the full report.

PhoneChip · RAMNeedsSpeedVerdict

~ = bandwidth-based estimate · ✓ = measured on real hardware

Granite 4.2 3B on 54 Mac configurations

Each Mac uses the recommended Q4_K_M at 4K context when it fits, or the largest smaller tracked quant that fits. Each row links to the full report with a macOS-specific setup guide.

MacUnified memoryQuantWorking budgetNeedsEstimated speedVerdict

FAQ

How much RAM do I need to run Granite 4.2 3B on a phone?

At Q4_K_M, Granite 4.2 3B needs ~3.1GB of usable memory (weights + KV cache + runtime). In practice that means a 6GB+ Android phone or a 6GB+ iPhone — iOS lets a single app use less of its RAM than Android does.

How fast does Granite 4.2 3B run on a flagship phone?

On the Galaxy S25 Ultra (Snapdragon 8 Elite) it runs at ~15.7 tokens/s at Q4_K_M, estimated from memory bandwidth. Anything above ~8 tokens/s feels smooth for chat.

Can an iPhone run Granite 4.2 3B?

Yes — the iPhone Air runs it at ~15.7 tokens/s at Q4_K_M, using 3.1GB of its ~7.8GB usable memory.

What is the best quantization of Granite 4.2 3B for mobile?

Q4_K_M (2.2GB download) is the size/quality sweet spot of the 8 quants available. Total memory needed is ~3.1GB once the KV cache and runtime are counted — the download size alone understates it.

How many phones can run Granite 4.2 3B?

138 of the 139 phones we track have enough estimated usable memory at Q4_K_M; 138 also reach our usable-speed threshold of 3 tokens/s, and 103 run smoothly. Memory-fit alone does not mean a good experience.

Which Macs can run Granite 4.2 3B?

54 of the 54 exact Mac configurations we track have enough estimated working memory. Each Mac uses the recommended Q4_K_M when it fits, or the largest smaller tracked quant that fits, and separates installed unified memory, the macOS reserve, and estimated speed.

What is Granite 4.2 3B good for on a phone?

It's tagged for chat, coding, reasoning. At 3B parameters, it's a fast, lightweight pick for quick tasks.

Similar models

Granite 4.2 8BGranite 4.2 30BMinistral 3 3BG9v3 3BSmolLM3 3B