SmolLM2 1.7B

At the default Q4_K_M, 140 of 140 phones have enough estimated usable memory; 140 also reach 3+ tokens/s. On Mac, 54 of 54 exact configurations pass using that quant or a smaller tracked fallback.

Params
1.7B
Family
smollm
Released
2024-11
Tags
chat

Downloads & memory by quant

The download is only the weights — add KV cache and runtime to get what your phone actually needs. “Memory-fit” only means it can load; “usable” also requires an estimated 3+ tokens/s. Each row uses that row's quant. ★ = recommended.

QuantDownloadMemory neededPhone reality
Q2_K0.7 GB~1.5 GB140 memory-fit · 140 usable
IQ4_XS0.9 GB~1.7 GB140 memory-fit · 140 usable
Q3_K_M0.9 GB~1.7 GB140 memory-fit · 140 usable
Q4_01 GB~1.8 GB140 memory-fit · 140 usable
Q4_K_S1 GB~1.8 GB140 memory-fit · 140 usable
Q4_K_M1.1 GB~1.9 GB140 memory-fit · 140 usable
Q5_K_M1.2 GB~2 GB140 memory-fit · 140 usable
Q6_K1.4 GB~2.2 GB139 memory-fit · 139 usable
Q8_01.8 GB~2.6 GB139 memory-fit · 139 usable

SmolLM2 1.7B at Q4_K_M on 140 phones

This table is fixed to the recommended Q4_K_M, on each phone's largest RAM option. Counts for smaller quants above will differ. All phones are shown, sorted by fit and estimated experience; tap one for the full report.

PhoneChip · RAMNeedsSpeedVerdict

~ = bandwidth-based estimate · ✓ = measured on real hardware

SmolLM2 1.7B on 54 Mac configurations

Each Mac uses the recommended Q4_K_M at 4K context when it fits, or the largest smaller tracked quant that fits. Each row links to the full report with a macOS-specific setup guide.

MacUnified memoryQuantWorking budgetNeedsEstimated speedVerdict

FAQ

How much RAM do I need to run SmolLM2 1.7B on a phone?

At Q4_K_M, SmolLM2 1.7B needs ~1.9GB of usable memory (weights + KV cache + runtime). In practice that means a 6GB+ Android phone or a 6GB+ iPhone — iOS lets a single app use less of its RAM than Android does.

How fast does SmolLM2 1.7B run on a flagship phone?

On the Galaxy S25 Ultra (Snapdragon 8 Elite) it runs at ~31.4 tokens/s at Q4_K_M, estimated from memory bandwidth. Anything above ~8 tokens/s feels smooth for chat.

Can an iPhone run SmolLM2 1.7B?

Yes — the iPhone 16 Pro Max runs it at ~24.5 tokens/s at Q4_K_M, using 1.9GB of its ~5.2GB usable memory.

What is the best quantization of SmolLM2 1.7B for mobile?

Q4_K_M (1.1GB download) is the size/quality sweet spot of the 9 quants available. Total memory needed is ~1.9GB once the KV cache and runtime are counted — the download size alone understates it.

How many phones can run SmolLM2 1.7B?

140 of the 140 phones we track have enough estimated usable memory at Q4_K_M; 140 also reach our usable-speed threshold of 3 tokens/s, and 127 run smoothly. Memory-fit alone does not mean a good experience.

Which Macs can run SmolLM2 1.7B?

54 of the 54 exact Mac configurations we track have enough estimated working memory. Each Mac uses the recommended Q4_K_M when it fits, or the largest smaller tracked quant that fits, and separates installed unified memory, the macOS reserve, and estimated speed.

What is SmolLM2 1.7B good for on a phone?

It's tagged for chat. At 1.7B parameters, it's a fast, lightweight pick for quick tasks.

Similar models

SmolLM3 3BQwen3 1.7BTernary Bonsai 1.7BDeepSeek R1 Distill 1.5BQwen 3.5 2B