Inkling Small

At the default Q4_K_M, 0 of 139 phones have enough estimated usable memory; 0 also reach 3+ tokens/s. On Mac, 9 of 54 exact configurations pass using that quant or a smaller tracked fallback.

Params
276B (12B active)
Family
thinkingmachines
Released
2026-07
Tags
chat · coding · vision · reasoning

Downloads & memory by quant

The download is only the weights — add KV cache and runtime to get what your phone actually needs. “Memory-fit” only means it can load; “usable” also requires an estimated 3+ tokens/s. Each row uses that row's quant. ★ = recommended.

QuantDownloadMemory neededPhone reality
IQ1_S74.8 GB~98.5 GB0 memory-fit
Q3_K_M119.4 GB~145.3 GB0 memory-fit
IQ4_XS127.4 GB~153.7 GB0 memory-fit
Q4_K_S152.3 GB~179.8 GB0 memory-fit
MXFP4158 GB~185.8 GB0 memory-fit
Q4_K_M162.5 GB~190.5 GB0 memory-fit
Q5_K_M196.1 GB~225.8 GB0 memory-fit
Q6_K218.9 GB~249.8 GB0 memory-fit
Q8_0280.3 GB~314.2 GB0 memory-fit

Inkling Small at Q4_K_M on 139 phones

This table is fixed to the recommended Q4_K_M, on each phone's largest RAM option. Counts for smaller quants above will differ. All phones are shown, sorted by fit and estimated experience; tap one for the full report.

PhoneChip · RAMNeedsSpeedVerdict

~ = bandwidth-based estimate · ✓ = measured on real hardware

Inkling Small on 54 Mac configurations

Each Mac uses the recommended Q4_K_M at 4K context when it fits, or the largest smaller tracked quant that fits. Each row links to the full report with a macOS-specific setup guide.

MacUnified memoryQuantWorking budgetNeedsEstimated speedVerdict

FAQ

How much RAM do I need to run Inkling Small on a phone?

At Q4_K_M, Inkling Small needs ~190.5GB of usable memory (weights + KV cache + runtime). In practice that means no current Android phone or no current iPhone — iOS lets a single app use less of its RAM than Android does.

How fast does Inkling Small run on a flagship phone?

It doesn't fit on any of the 139 phones we track at Q4_K_M — it needs ~190.5GB of usable memory.

Can an iPhone run Inkling Small?

Not really: the best iPhone we track (iPhone 16 Pro Max) has ~5.2GB usable, but Inkling Small needs 190.5GB at Q4_K_M.

What is the best quantization of Inkling Small for mobile?

Q4_K_M (162.5GB download) is the size/quality sweet spot of the 9 quants available. Total memory needed is ~190.5GB once the KV cache and runtime are counted — the download size alone understates it.

How many phones can run Inkling Small?

0 of the 139 phones we track have enough estimated usable memory at Q4_K_M; 0 also reach our usable-speed threshold of 3 tokens/s, and 0 run smoothly. Memory-fit alone does not mean a good experience.

Which Macs can run Inkling Small?

9 of the 54 exact Mac configurations we track have enough estimated working memory. Each Mac uses the recommended Q4_K_M when it fits, or the largest smaller tracked quant that fits, and separates installed unified memory, the macOS reserve, and estimated speed.

What is Inkling Small good for on a phone?

It's tagged for chat, coding, vision, reasoning. At 276B parameters (12B active — it's a MoE, so it decodes faster than its size suggests), it prioritizes answer quality over speed — expect slower decoding.

Similar models

InklingDeepSeek V4 Flash 0731Hunyuan 3 (Hy3)Ornith 1.0 397BLing 3.0 Flash