aicanrun

Can I run MiniCPM5-2B locally?

Yes—its official 1.6GB Q4_K_M GGUF fits on modern phones, Macs, and PCs. At Q4_K_M, the estimated 4K working set is ~2.5GB. It is a dense 2.52B bilingual model aimed at local assistants, coding, and tool use. Basic chat works through llama.cpp or Ollama; reliable agent tool execution still needs a compatible tool-calling harness.

Params
2.52B
Family
minicpm
Released
2026-09
Tags
chat · coding · reasoning
Weights
MiniCPM5-2B-GGUF ↗

How to run MiniCPM5-2B locally

OpenBMB publishes this GGUF and the commands below. Start at 4K context, confirm a clean text response, then increase context while watching memory. The advertised 128K maximum is a model capability—not a promise that a low-memory phone can allocate the full KV cache. For native tool calling, OpenBMB recommends SGLang with its minicpm5 tool parser.

MAC OR PC · LLAMA.CPP
llama serve -hf openbmb/MiniCPM5-2B-GGUF:Q4_K_M
# Or with Ollama:
ollama run hf.co/openbmb/MiniCPM5-2B-GGUF:Q4_K_M
OpenBMB official GGUF files and instructions ↗

Memory figures on this page are planning estimates from GGUF bytes, 5% weight overhead, a 4K KV cache, and runtime allowance—not measured peak allocation or a speed guarantee.

Downloads & memory by quant

The download is only the weights — add KV cache and runtime to get what your phone actually needs. “Memory-fit” only means it can load; “usable” also requires an estimated 3+ tokens/s. Each row uses that row's quant. ★ = recommended.

QuantDownloadMemory neededPhone reality
Q4_K_M ★1.6 GB~2.5 GB139 memory-fit · 139 usable
Q8_02.7 GB~3.6 GB139 memory-fit · 127 usable

MiniCPM5-2B at Q4_K_M on 140 phones

This table is fixed to the recommended Q4_K_M, on each phone's largest RAM option. Counts for smaller quants above will differ. All phones are shown, sorted by fit and estimated experience; tap one for the full report.

PhoneChip · RAMNeedsSpeedVerdict
Galaxy S25 UltraSnapdragon 8 Elite · 16 GB2.5 / 12 GB~21.6 tokens/s✓ Runs great
Galaxy S25Snapdragon 8 Elite · 12 GB2.5 / 9 GB~21.6 tokens/s✓ Runs great
Galaxy S24 UltraSnapdragon 8 Gen 3 · 12 GB2.5 / 9 GB~21.6 tokens/s✓ Runs great
Galaxy S24Samsung Exynos 2400 · 12 GB2.5 / 9 GB~18.9 tokens/s✓ Runs great
Galaxy S23 UltraSnapdragon 8 Gen 2 · 12 GB2.5 / 9 GB~18.9 tokens/s✓ Runs great
iPhone 16 Pro MaxApple A18 Pro · 8 GB2.5 / 5.2 GB~16.9 tokens/s✓ Runs great
iPhone 16 ProApple A18 Pro · 8 GB2.5 / 5.2 GB~16.9 tokens/s✓ Runs great
iPhone 16Apple A18 · 8 GB2.5 / 5.2 GB~16.9 tokens/s✓ Runs great
Pixel 9 ProGoogle Tensor G4 · 16 GB2.5 / 12 GB~19.2 tokens/s✓ Runs great
Pixel 9Google Tensor G4 · 12 GB2.5 / 9 GB~19.2 tokens/s✓ Runs great
Pixel 8 ProGoogle Tensor G3 · 12 GB2.5 / 9 GB~19.2 tokens/s✓ Runs great
Pixel 8aGoogle Tensor G3 · 8 GB2.5 / 6 GB~19.2 tokens/s✓ Runs great
OnePlus 13Snapdragon 8 Elite · 24 GB2.5 / 20 GB~21.6 tokens/s✓ Runs great
OnePlus 12Snapdragon 8 Gen 3 · 24 GB2.5 / 20 GB~21.6 tokens/s✓ Runs great
Xiaomi 15 ProSnapdragon 8 Elite · 16 GB2.5 / 12 GB~21.6 tokens/s✓ Runs great
Xiaomi 14Snapdragon 8 Gen 3 · 16 GB2.5 / 12 GB~21.6 tokens/s✓ Runs great
POCO X6 ProDimensity 8300 Ultra · 12 GB2.5 / 9 GB~19.2 tokens/s✓ Runs great
OPPO Find X8 ProDimensity 9400 · 16 GB2.5 / 12 GB~24 tokens/s✓ Runs great
vivo X200 ProDimensity 9400 · 16 GB2.5 / 12 GB~24 tokens/s✓ Runs great
vivo X100 ProDimensity 9300 · 16 GB2.5 / 12 GB~21.6 tokens/s✓ Runs great
ROG Phone 9 ProSnapdragon 8 Elite · 24 GB2.5 / 20 GB~21.6 tokens/s✓ Runs great
Nothing Phone (3)Snapdragon 8s Gen 4 · 16 GB2.5 / 12 GB~21.6 tokens/s✓ Runs great
Motorola Edge 50 UltraSnapdragon 8s Gen 3 · 16 GB2.5 / 12 GB~18.9 tokens/s✓ Runs great
HONOR Magic7 ProSnapdragon 8 Elite · 16 GB2.5 / 12 GB~21.6 tokens/s✓ Runs great
iPhone 17Apple A19 · 8 GB2.5 / 5.2 GB~19.2 tokens/s✓ Runs great
iPhone AirApple A19 Pro · 12 GB2.5 / 7.8 GB~21.6 tokens/s✓ Runs great
iPhone 17 ProApple A19 Pro · 12 GB2.5 / 7.8 GB~21.6 tokens/s✓ Runs great
iPhone 17 Pro MaxApple A19 Pro · 12 GB2.5 / 7.8 GB~21.6 tokens/s✓ Runs great
Galaxy S26Snapdragon 8 Elite Gen 5 · 12 GB2.5 / 9 GB~23.8 tokens/s✓ Runs great
Galaxy S26+Snapdragon 8 Elite Gen 5 · 12 GB2.5 / 9 GB~23.8 tokens/s✓ Runs great
Galaxy S26 UltraSnapdragon 8 Elite Gen 5 · 16 GB2.5 / 12 GB~23.8 tokens/s✓ Runs great
Galaxy S26 FEExynos 2500 · 8 GB2.5 / 6 GB~21.6 tokens/s✓ Runs great
Xiaomi 17Snapdragon 8 Elite Gen 5 · 16 GB2.5 / 12 GB~23.8 tokens/s✓ Runs great
Xiaomi 17 ProSnapdragon 8 Elite Gen 5 · 16 GB2.5 / 12 GB~23.8 tokens/s✓ Runs great
OnePlus 15Snapdragon 8 Elite Gen 5 · 16 GB2.5 / 12 GB~23.8 tokens/s✓ Runs great
vivo X300 ProDimensity 9500 · 16 GB2.5 / 12 GB~24 tokens/s✓ Runs great
vivo X300 ESnapdragon 8 Gen 5 · 12 GB2.5 / 9 GB~21.6 tokens/s✓ Runs great
OPPO Find X9 ProDimensity 9500 · 16 GB2.5 / 12 GB~24 tokens/s✓ Runs great
Pixel 10Google Tensor G5 · 12 GB2.5 / 9 GB~19.2 tokens/s✓ Runs great
Pixel 10 ProGoogle Tensor G5 · 16 GB2.5 / 12 GB~19.2 tokens/s✓ Runs great
Pixel 11Google Tensor G6 · 12 GB2.5 / 9 GB~19.2 tokens/s✓ Runs great
Pixel 11 ProGoogle Tensor G6 · 16 GB2.5 / 12 GB~19.2 tokens/s✓ Runs great
Pixel 11 Pro XLGoogle Tensor G6 · 16 GB2.5 / 12 GB~19.2 tokens/s✓ Runs great
iPhone 16eApple A18 · 8 GB2.5 / 5.2 GB~16.9 tokens/s✓ Runs great
Pixel 9aGoogle Tensor G4 · 8 GB2.5 / 6 GB~19.2 tokens/s✓ Runs great
Galaxy S25 FESamsung Exynos 2400 · 8 GB2.5 / 6 GB~18.9 tokens/s✓ Runs great
Galaxy Z Fold6Snapdragon 8 Gen 3 · 12 GB2.5 / 9 GB~21.6 tokens/s✓ Runs great
Galaxy Z Flip6Snapdragon 8 Gen 3 · 12 GB2.5 / 9 GB~21.6 tokens/s✓ Runs great
Galaxy Z Fold7Snapdragon 8 Elite · 16 GB2.5 / 12 GB~21.6 tokens/s✓ Runs great
Galaxy Z Flip7Exynos 2500 · 12 GB2.5 / 9 GB~21.6 tokens/s✓ Runs great
Motorola Razr Ultra (2025)Snapdragon 8 Elite · 16 GB2.5 / 12 GB~21.6 tokens/s✓ Runs great
OnePlus 13RSnapdragon 8 Gen 3 · 16 GB2.5 / 12 GB~21.6 tokens/s✓ Runs great
OnePlus 15RSnapdragon 8 Gen 5 · 16 GB2.5 / 12 GB~21.6 tokens/s✓ Runs great
Pixel 9 Pro XLGoogle Tensor G4 · 16 GB2.5 / 12 GB~19.2 tokens/s✓ Runs great
Pixel 10 Pro XLGoogle Tensor G5 · 16 GB2.5 / 12 GB~19.2 tokens/s✓ Runs great
iPhone 17eApple A19 · 8 GB2.5 / 5.2 GB~19.2 tokens/s✓ Runs great
Pixel 10aGoogle Tensor G4 · 8 GB2.5 / 6 GB~19.2 tokens/s✓ Runs great
Motorola Razr+ (2026)Snapdragon 8s Gen 3 · 12 GB2.5 / 9 GB~18.9 tokens/s✓ Runs great
Motorola Razr Ultra (2026)Snapdragon 8 Elite · 16 GB2.5 / 12 GB~21.6 tokens/s✓ Runs great
RedMagic 11 AirSnapdragon 8 Elite · 16 GB2.5 / 12 GB~21.6 tokens/s✓ Runs great
RedMagic 11S ProSnapdragon 8 Elite Gen 5 · 16 GB2.5 / 12 GB~23.8 tokens/s✓ Runs great
Xiaomi 15TDimensity 8400 Ultra · 12 GB2.5 / 9 GB~19.2 tokens/s✓ Runs great
Xiaomi 15T ProDimensity 9400+ · 12 GB2.5 / 9 GB~24 tokens/s✓ Runs great
POCO X7 ProDimensity 8400 Ultra · 12 GB2.5 / 9 GB~19.2 tokens/s✓ Runs great
Honor Magic8 ProSnapdragon 8 Elite Gen 5 · 16 GB2.5 / 12 GB~23.8 tokens/s✓ Runs great
AQUOS R10Snapdragon 7+ Gen 3 · 12 GB2.5 / 9 GB~18.9 tokens/s✓ Runs great
Xperia 1 VIISnapdragon 8 Elite · 16 GB2.5 / 12 GB~21.6 tokens/s✓ Runs great
Xperia 1 VIIISnapdragon 8 Elite Gen 5 · 16 GB2.5 / 12 GB~23.8 tokens/s✓ Runs great
Galaxy Z Fold8Snapdragon 8 Elite Gen 5 · 16 GB2.5 / 12 GB~23.8 tokens/s✓ Runs great
Galaxy Z Fold8 UltraSnapdragon 8 Elite Gen 5 · 16 GB2.5 / 12 GB~23.8 tokens/s✓ Runs great
Galaxy Z Flip8Samsung Exynos 2600 · 12 GB2.5 / 9 GB~24 tokens/s✓ Runs great
Galaxy Z Fold5Snapdragon 8 Gen 2 · 12 GB2.5 / 9 GB~18.9 tokens/s✓ Runs great
Galaxy Z Flip5Snapdragon 8 Gen 2 · 8 GB2.5 / 6 GB~18.9 tokens/s✓ Runs great
Xiaomi MIX Fold 3Snapdragon 8 Gen 2 · 16 GB2.5 / 12 GB~18.9 tokens/s✓ Runs great
Xiaomi MIX Fold 4Snapdragon 8 Gen 3 · 16 GB2.5 / 12 GB~21.6 tokens/s✓ Runs great
Xiaomi MIX FlipSnapdragon 8 Gen 3 · 16 GB2.5 / 12 GB~21.6 tokens/s✓ Runs great
Xiaomi MIX Flip 2Snapdragon 8 Elite · 16 GB2.5 / 12 GB~21.6 tokens/s✓ Runs great
Honor Magic V2Snapdragon 8 Gen 2 · 16 GB2.5 / 12 GB~18.9 tokens/s✓ Runs great
Honor Magic V3Snapdragon 8 Gen 3 · 16 GB2.5 / 12 GB~21.6 tokens/s✓ Runs great
Honor Magic V5Snapdragon 8 Elite · 16 GB2.5 / 12 GB~21.6 tokens/s✓ Runs great
Honor Magic V6Snapdragon 8 Elite Gen 5 · 16 GB2.5 / 12 GB~23.8 tokens/s✓ Runs great
HONOR Robot PhoneSnapdragon 8 Elite Gen 5 · 16 GB2.5 / 12 GB~23.8 tokens/s✓ Runs great
OPPO Find N3Snapdragon 8 Gen 2 · 16 GB2.5 / 12 GB~18.9 tokens/s✓ Runs great
OnePlus OpenSnapdragon 8 Gen 2 · 16 GB2.5 / 12 GB~18.9 tokens/s✓ Runs great
OPPO Find N5Snapdragon 8 Elite · 16 GB2.5 / 12 GB~21.6 tokens/s✓ Runs great
OPPO Find N6Snapdragon 8 Elite Gen 5 · 16 GB2.5 / 12 GB~23.8 tokens/s✓ Runs great
vivo X Fold3Snapdragon 8 Gen 2 · 16 GB2.5 / 12 GB~18.9 tokens/s✓ Runs great
vivo X Fold3 ProSnapdragon 8 Gen 3 · 16 GB2.5 / 12 GB~21.6 tokens/s✓ Runs great
vivo X Fold5Snapdragon 8 Gen 3 · 16 GB2.5 / 12 GB~21.6 tokens/s✓ Runs great
vivo X Fold6Dimensity 9500 · 16 GB2.5 / 12 GB~24 tokens/s✓ Runs great
Pixel 9 Pro FoldGoogle Tensor G4 · 16 GB2.5 / 12 GB~19.2 tokens/s✓ Runs great
Pixel 10 Pro FoldGoogle Tensor G5 · 16 GB2.5 / 12 GB~19.2 tokens/s✓ Runs great
Pixel 11 Pro FoldGoogle Tensor G6 · 16 GB2.5 / 12 GB~19.2 tokens/s✓ Runs great
Huawei Mate X6Kirin 9020 · 16 GB2.5 / 12 GB~19.2 tokens/s✓ Runs great
Huawei Mate X7Kirin 9030 Pro · 20 GB2.5 / 16 GB~21.6 tokens/s✓ Runs great
Motorola Razr+ (2024)Snapdragon 8s Gen 3 · 12 GB2.5 / 9 GB~18.9 tokens/s✓ Runs great
Motorola Razr+ (2025)Snapdragon 8s Gen 3 · 12 GB2.5 / 9 GB~18.9 tokens/s✓ Runs great
Motorola Razr FoldSnapdragon 8 Gen 5 · 16 GB2.5 / 12 GB~21.6 tokens/s✓ Runs great
iPhone 15 ProApple A17 Pro · 8 GB2.5 / 5.2 GB~14.4 tokens/s✓ Runs great
Xiaomi MIX Fold 2Snapdragon 8+ Gen 1 · 12 GB2.5 / 9 GB~14.4 tokens/s✓ Runs great
Pixel FoldTensor G2 · 12 GB2.5 / 9 GB~14.4 tokens/s✓ Runs great
Motorola Razr+ (2023)Snapdragon 8+ Gen 1 · 12 GB2.5 / 9 GB~14.4 tokens/s✓ Runs great
iPhone 15Apple A16 Bionic · 6 GB2.5 / 3.9 GB~14.4 tokens/s✓ Runs great
Galaxy A57 5GExynos 1680 · 12 GB2.5 / 9 GB~9.6 tokens/s✓ Runs great
Nothing Phone (4a) ProSnapdragon 7 Gen 4 · 12 GB2.5 / 9 GB~9.5 tokens/s✓ Runs great
iPhone 14Apple A15 Bionic · 6 GB2.5 / 3.9 GB~9.6 tokens/s✓ Runs great
Galaxy A55Exynos 1480 · 12 GB2.5 / 9 GB~7.2 tokens/s! Runs, barely
Redmi Note 13 ProSnapdragon 7s Gen 2 · 12 GB2.5 / 9 GB~7.2 tokens/s! Runs, barely
Nothing Phone (2a)Dimensity 7200 Pro · 12 GB2.5 / 9 GB~7.2 tokens/s! Runs, barely
Nothing Phone (3a)Snapdragon 7s Gen 3 · 12 GB2.5 / 9 GB~7.2 tokens/s! Runs, barely
Galaxy A26 5GExynos 1380 · 8 GB2.5 / 6 GB~7.2 tokens/s! Runs, barely
Galaxy A36 5GSnapdragon 6 Gen 3 · 12 GB2.5 / 9 GB~7.2 tokens/s! Runs, barely
Galaxy A56 5GExynos 1580 · 12 GB2.5 / 9 GB~7.2 tokens/s! Runs, barely
Moto G Stylus (2025)Snapdragon 6 Gen 3 · 8 GB2.5 / 6 GB~7.2 tokens/s! Runs, barely
Moto G Stylus (2026)Snapdragon 6 Gen 3 · 8 GB2.5 / 6 GB~7.2 tokens/s! Runs, barely
Galaxy A37 5GExynos 1480 · 12 GB2.5 / 9 GB~7.2 tokens/s! Runs, barely
Motorola Edge (2026)Dimensity 7450 · 8 GB2.5 / 6 GB~7.2 tokens/s! Runs, barely
Redmi Note 14 Pro 5GDimensity 7300 · 12 GB2.5 / 9 GB~7.2 tokens/s! Runs, barely
Redmi Note 15 Pro 5GDimensity 7400 Ultra · 12 GB2.5 / 9 GB~7.2 tokens/s! Runs, barely
Redmi Note 15 5GSnapdragon 6 Gen 3 · 12 GB2.5 / 9 GB~7.2 tokens/s! Runs, barely
Redmi Note 14 Pro+ 5GSnapdragon 7s Gen 3 · 12 GB2.5 / 9 GB~7.2 tokens/s! Runs, barely
Redmi Note 15 Pro+ 5GSnapdragon 7s Gen 4 · 12 GB2.5 / 9 GB~7.2 tokens/s! Runs, barely
Honor 400Snapdragon 7 Gen 3 · 12 GB2.5 / 9 GB~7.2 tokens/s! Runs, barely
CMF Phone 2 ProDimensity 7300 · 8 GB2.5 / 6 GB~7.2 tokens/s! Runs, barely
AQUOS sense10Snapdragon 7s Gen 3 · 8 GB2.5 / 6 GB~7.2 tokens/s! Runs, barely
AQUOS sense9Snapdragon 7s Gen 2 · 8 GB2.5 / 6 GB~7.2 tokens/s! Runs, barely
Xperia 10 VIISnapdragon 6 Gen 3 · 8 GB2.5 / 6 GB~7.2 tokens/s! Runs, barely
Galaxy A16 5GExynos 1330 · 8 GB2.5 / 6 GB~4.8 tokens/s! Runs, barely
Galaxy A17 5GExynos 1330 · 8 GB2.5 / 6 GB~4.8 tokens/s! Runs, barely
Moto G (2025)Dimensity 6300 · 8 GB2.5 / 6 GB~4.8 tokens/s! Runs, barely
Moto G Power (2025)Dimensity 6300 · 8 GB2.5 / 6 GB~4.8 tokens/s! Runs, barely
Moto G Power (2026)Dimensity 6300 · 8 GB2.5 / 6 GB~4.8 tokens/s! Runs, barely
Motorola Razr (2025)Dimensity 7400X · 8 GB2.5 / 6 GB~4.8 tokens/s! Runs, barely
Motorola Razr (2026)Dimensity 7450X · 8 GB2.5 / 6 GB~4.8 tokens/s! Runs, barely
Motorola Razr (2024)Dimensity 7300X · 12 GB2.5 / 9 GB~4.8 tokens/s! Runs, barely
Redmi Note 17Snapdragon 4 Gen 4 · 8 GB2.5 / 6 GB~4.8 tokens/s! Runs, barely
vivo S2Dimensity 7360-Turbo · 8 GB2.5 / 6 GB~4.8 tokens/s! Runs, barely
vivo V80 Lite 5G (Pakistan)Dimensity 7360-Turbo · 8 GB2.5 / 6 GB~4.8 tokens/s! Runs, barely
iQOO Z11 LiteDimensity 6300 · 8 GB2.5 / 6 GB~4.8 tokens/s! Runs, barely
Moto G (2026)Dimensity 6300 · 4 GB2.5 / 2 GB—✕ Won't fit

~ = bandwidth-based estimate · ✓ = measured on real hardware

MiniCPM5-2B on 54 Mac configurations

Each Mac uses the recommended Q4_K_M at 4K context when it fits, or the largest smaller tracked quant that fits. Each row links to the full report with a macOS-specific setup guide.

MacUnified memoryQuantWorking budgetNeedsEstimated speedVerdict
Mac Studio M5 Ultra512 GBQ4_K_M504 GB2.7 GB~375–525 tokens/s✓ Runs great
Mac Studio M3 Ultra512 GBQ4_K_M504 GB2.7 GB~255.9–358.3 tokens/s✓ Runs great
Mac Studio M5 Ultra256 GBQ4_K_M248 GB2.7 GB~375–525 tokens/s✓ Runs great
Mac Studio M3 Ultra256 GBQ4_K_M248 GB2.7 GB~255.9–358.3 tokens/s✓ Runs great
Mac Studio M5 Max128 GBQ4_K_M120 GB2.7 GB~191.9–268.6 tokens/s✓ Runs great
MacBook Pro M5 Max128 GBQ4_K_M120 GB2.7 GB~191.9–268.6 tokens/s✓ Runs great
Mac Studio M4 Max128 GBQ4_K_M120 GB2.7 GB~170.6–238.9 tokens/s✓ Runs great
MacBook Pro M4 Max128 GBQ4_K_M120 GB2.7 GB~170.6–238.9 tokens/s✓ Runs great
MacBook Pro M3 Max128 GBQ4_K_M120 GB2.7 GB~125–175 tokens/s✓ Runs great
Mac Studio M5 Ultra96 GBQ4_K_M88 GB2.7 GB~375–525 tokens/s✓ Runs great
Mac Studio M3 Ultra96 GBQ4_K_M88 GB2.7 GB~255.9–358.3 tokens/s✓ Runs great
Mac mini M5 Pro64 GBQ4_K_M57.6 GB2.7 GB~95.9–134.3 tokens/s✓ Runs great
Mac Studio M5 Max64 GBQ4_K_M57.6 GB2.7 GB~191.9–268.6 tokens/s✓ Runs great
MacBook Pro M5 Pro64 GBQ4_K_M57.6 GB2.7 GB~95.9–134.3 tokens/s✓ Runs great
MacBook Pro M5 Max64 GBQ4_K_M57.6 GB2.7 GB~191.9–268.6 tokens/s✓ Runs great
Mac Studio M4 Max64 GBQ4_K_M57.6 GB2.7 GB~170.6–238.9 tokens/s✓ Runs great
Mac mini M4 Pro64 GBQ4_K_M57.6 GB2.7 GB~85.3–119.4 tokens/s✓ Runs great
MacBook Pro M4 Max64 GBQ4_K_M57.6 GB2.7 GB~170.6–238.9 tokens/s✓ Runs great
MacBook Pro M3 Max64 GBQ4_K_M57.6 GB2.7 GB~125–175 tokens/s✓ Runs great
Mac mini M5 Pro48 GBQ4_K_M43.2 GB2.7 GB~95.9–134.3 tokens/s✓ Runs great
Mac Studio M5 Max48 GBQ4_K_M43.2 GB2.7 GB~191.9–268.6 tokens/s✓ Runs great
MacBook Pro M5 Pro48 GBQ4_K_M43.2 GB2.7 GB~95.9–134.3 tokens/s✓ Runs great
Mac Studio M4 Max48 GBQ4_K_M43.2 GB2.7 GB~170.6–238.9 tokens/s✓ Runs great
Mac mini M4 Pro48 GBQ4_K_M43.2 GB2.7 GB~85.3–119.4 tokens/s✓ Runs great
MacBook Pro M4 Pro48 GBQ4_K_M43.2 GB2.7 GB~85.3–119.4 tokens/s✓ Runs great
Mac Studio M5 Max36 GBQ4_K_M32.4 GB2.7 GB~143.8–201.3 tokens/s✓ Runs great
MacBook Pro M5 Max36 GBQ4_K_M32.4 GB2.7 GB~143.8–201.3 tokens/s✓ Runs great
Mac Studio M4 Max36 GBQ4_K_M32.4 GB2.7 GB~128.1–179.4 tokens/s✓ Runs great
MacBook Pro M4 Max36 GBQ4_K_M32.4 GB2.7 GB~128.1–179.4 tokens/s✓ Runs great
MacBook Pro M3 Pro36 GBQ4_K_M32.4 GB2.7 GB~46.9–65.6 tokens/s✓ Runs great
MacBook Pro M3 Max36 GBQ4_K_M32.4 GB2.7 GB~93.8–131.3 tokens/s✓ Runs great
Mac mini M632 GBQ4_K_M28.8 GB2.7 GB~53.1–74.4 tokens/s✓ Runs great
Mac mini M5 Pro32 GBQ4_K_M28.8 GB2.7 GB~95.9–134.3 tokens/s✓ Runs great
MacBook Air M532 GBQ4_K_M28.8 GB2.7 GB~40.2–55.5 tokens/s✓ Runs great
MacBook Air M432 GBQ4_K_M28.8 GB2.7 GB~31.5–43.5 tokens/s✓ Runs great
Mac mini M432 GBQ4_K_M28.8 GB2.7 GB~37.5–52.5 tokens/s✓ Runs great
Mac mini M624 GBQ4_K_M21 GB2.7 GB~53.1–74.4 tokens/s✓ Runs great
Mac mini M5 Pro24 GBQ4_K_M21 GB2.7 GB~95.9–134.3 tokens/s✓ Runs great
MacBook Air M524 GBQ4_K_M21 GB2.7 GB~40.2–55.5 tokens/s✓ Runs great
MacBook Pro M5 Pro24 GBQ4_K_M21 GB2.7 GB~95.9–134.3 tokens/s✓ Runs great
MacBook Air M424 GBQ4_K_M21 GB2.7 GB~31.5–43.5 tokens/s✓ Runs great
Mac mini M424 GBQ4_K_M21 GB2.7 GB~37.5–52.5 tokens/s✓ Runs great
Mac mini M4 Pro24 GBQ4_K_M21 GB2.7 GB~85.3–119.4 tokens/s✓ Runs great
MacBook Air M324 GBQ4_K_M21 GB2.7 GB~26.3–36.2 tokens/s✓ Runs great
MacBook Pro M4 Pro24 GBQ4_K_M21 GB2.7 GB~85.3–119.4 tokens/s✓ Runs great
MacBook Pro M3 Pro18 GBQ4_K_M15 GB2.7 GB~46.9–65.6 tokens/s✓ Runs great
Mac mini M616 GBQ4_K_M13 GB2.7 GB~53.1–74.4 tokens/s✓ Runs great
MacBook Air M516 GBQ4_K_M13 GB2.7 GB~40.2–55.5 tokens/s✓ Runs great
MacBook Air M416 GBQ4_K_M13 GB2.7 GB~31.5–43.5 tokens/s✓ Runs great
Mac mini M416 GBQ4_K_M13 GB2.7 GB~37.5–52.5 tokens/s✓ Runs great
MacBook Air M316 GBQ4_K_M13 GB2.7 GB~26.3–36.2 tokens/s✓ Runs great
MacBook Air M116 GBQ4_K_M13 GB2.7 GB~17.9–24.8 tokens/s✓ Runs great
MacBook Neo A18 Pro8 GBQ4_K_M5 GB2.7 GB~15.7–21.7 tokens/s✓ Runs great
MacBook Air M18 GBQ4_K_M5 GB2.7 GB~17.9–24.8 tokens/s✓ Runs great

FAQ

How much RAM do I need to run MiniCPM5-2B on a phone?

At Q4_K_M, MiniCPM5-2B needs ~2.5GB of usable memory (weights + KV cache + runtime). In practice that means a 6GB+ Android phone or a 6GB+ iPhone — iOS lets a single app use less of its RAM than Android does.

How fast does MiniCPM5-2B run on a flagship phone?

On the Galaxy S25 Ultra (Snapdragon 8 Elite) it runs at ~21.6 tokens/s at Q4_K_M, estimated from memory bandwidth. Anything above ~8 tokens/s feels smooth for chat.

Can an iPhone run MiniCPM5-2B?

Yes — the iPhone 16 Pro Max runs it at ~16.9 tokens/s at Q4_K_M, using 2.5GB of its ~5.2GB usable memory.

What is the best quantization of MiniCPM5-2B for mobile?

Q4_K_M (1.6GB download) is the size/quality sweet spot of the 2 quants available. Total memory needed is ~2.5GB once the KV cache and runtime are counted — the download size alone understates it.

How many phones can run MiniCPM5-2B?

139 of the 140 phones we track have enough estimated usable memory at Q4_K_M; 139 also reach our usable-speed threshold of 3 tokens/s, and 106 run smoothly. Memory-fit alone does not mean a good experience.

Which Macs can run MiniCPM5-2B?

54 of the 54 exact Mac configurations we track have enough estimated working memory. Each Mac uses the recommended Q4_K_M when it fits, or the largest smaller tracked quant that fits, and separates installed unified memory, the macOS reserve, and estimated speed.

What is MiniCPM5-2B good for on a phone?

It's tagged for chat, coding, reasoning. At 2.52B parameters, it's a fast, lightweight pick for quick tasks.

Similar models

LFM2.5 2.6BMinistral 3 3BG9v3 3BGranite 4.2 3BQwen 3.5 2B