aicanrun

AI Models for iPhone 16e — What runs on 8GB

28 great · 1 slow · 64 won't fit
Chip
Apple A18
Memory bandwidth
60 GB/s
NPU
35 TOPS
RAM options
8 GB
Usable for models
~5.2 GB
Year
2025

Specs checked against manufacturer and public documentation on .

What runs on the iPhone 16e

All 93 models at their recommended quant, on the 8GB configuration. Select any row for the full report.

ModelParamsQuantNeedsSpeedVerdict
Qwen3 0.6B0.6BQ8_01.3 GB~45 tokens/s✓ Runs great
Qwen3 1.7B1.7BQ8_02.6 GB~15 tokens/s✓ Runs great
Llama 3.2 1B1.2BQ4_K_M1.5 GB~33.8 tokens/s✓ Runs great
Gemma 3 1B1BQ4_K_M1.5 GB~33.8 tokens/s✓ Runs great
DeepSeek R1 Distill 1.5B1.8BQ4_K_M1.9 GB~24.5 tokens/s✓ Runs great
SmolLM2 1.7B1.7BQ4_K_M1.9 GB~24.5 tokens/s✓ Runs great
Qwen 3.5 2B2BQ4_K_M2.1 GB~20.8 tokens/s✓ Runs great
Ternary Bonsai 4B4BQ2_02 GB~24.5 tokens/s✓ Runs great
Ternary Bonsai 1.7B1.7BQ2_01.2 GB~54 tokens/s✓ Runs great
LFM2.5 2.6B2.7BQ4_K_M2.6 GB~15.9 tokens/s✓ Runs great
LFM2.5-VL 3B3.1BQ4_K_M2.6 GB~15.9 tokens/s✓ Runs great
OvisOCR2 0.8B0.8BQ4_K_M1.3 GB~45 tokens/s✓ Runs great
SmolLM3 3B3.1BQ4_K_M2.8 GB~14.2 tokens/s✓ Runs great
G9v3 3B3BQ4_K_M2.8 GB~14.2 tokens/s✓ Runs great
Llama 3.2 3B3.2BQ4_K_M2.9 GB~13.5 tokens/s✓ Runs great
Ministral 3 3B3BQ4_K_M3 GB~12.9 tokens/s✓ Runs great
Granite 4.2 3B3BQ4_K_M3.1 GB~12.3 tokens/s✓ Runs great
Ternary Bonsai 8B8BQ2_03.5 GB~12.3 tokens/s✓ Runs great
Qwen3 4B4BQ4_K_M3.5 GB~10.8 tokens/s✓ Runs great
Gemma 3 4B4.3BQ4_K_M3.5 GB~10.8 tokens/s✓ Runs great
Phi-4 Mini 3.8B3.8BQ4_K_M3.5 GB~10.8 tokens/s✓ Runs great
Qwen 3.5 4B4BQ4_K_M3.7 GB~10 tokens/s✓ Runs great
Agents-A1 4B4BQ4_K_M3.7 GB~10 tokens/s✓ Runs great
Nanbeige 4.2 3B4.2BQ4_K_M3.7 GB~10 tokens/s✓ Runs great
Nemotron 3 Nano 4B4BQ4_K_M3.8 GB~9.6 tokens/s✓ Runs great
AREX Turbo 4B4.5BQ4_K_M4 GB~9.3 tokens/s✓ Runs great
Fara 1.5 4B4.5BQ4_K_M4 GB~9.3 tokens/s✓ Runs great
Gemma 4 E2B2BQ4_K_M4 GB~8.7 tokens/s✓ Runs great
Bonsai 27B (1-bit)27BQ1_04.8 GB~7.1 tokens/s! Runs, barely
Mistral 7B v0.37.2BQ4_K_M5.7 GB—✕ Won't fit
DeepSeek R1 Distill 7B7.6BQ4_K_M6.1 GB—✕ Won't fit
Gemma 4 E4B4BQ4_K_M6.1 GB—✕ Won't fit
Llama 3.1 8B8BQ4_K_M6.3 GB—✕ Won't fit
Ministral 8B8BQ4_K_M6.3 GB—✕ Won't fit
Ling 3.0 Tiny7.9BQ4_K_M6.3 GB—✕ Won't fit
Qwen3 8B8.2BQ4_K_M6.4 GB—✕ Won't fit
Ministral 3 8B8BQ4_K_M6.6 GB—✕ Won't fit
LFM2.5 8B-A1B8BQ4_K_M6.6 GB—✕ Won't fit
Tini Cybersec 8B-A1B8.5BQ4_K_M6.7 GB—✕ Won't fit
Granite 4.2 8B8BQ4_K_M6.7 GB—✕ Won't fit
Ornith 1.0 9B9BQ4_K_M7.1 GB—✕ Won't fit
Qwen 3.5 9B9BQ4_K_M7.2 GB—✕ Won't fit
Qwythos 9B v29BQ4_K_M7.2 GB—✕ Won't fit
GRM 3.2 Cliff 9B9.4BQ4_K_M7.5 GB—✕ Won't fit
grug 9B (ProCreations)9.4BQ4_K_M7.5 GB—✕ Won't fit
Fara 1.5 9B9.4BQ4_K_M7.5 GB—✕ Won't fit
UI-Mate 9B9BQ4_K_M7.4 GB—✕ Won't fit
Ternary Bonsai 27B27BQ2_08.4 GB—✕ Won't fit
Gemma 4 12B12BQ4_08.8 GB—✕ Won't fit
Gemma 3 12B12.2BQ4_K_M9.1 GB—✕ Won't fit
Grug 12B12BQ4_K_M9.5 GB—✕ Won't fit
Ministral 3 14B14BQ4_K_M10.2 GB—✕ Won't fit
Qwen3 14B14.8BQ4_K_M11.1 GB—✕ Won't fit
Qwen3 30B A3B30.5BQ4_K_M22.3 GB—✕ Won't fit
Phi-4 14B14.7BQ4_K_M11.2 GB—✕ Won't fit
Qwen 3.5 27B27BQ4_K_M20 GB—✕ Won't fit
Qwen 3.5 35B-A3B35BQ4_K_M26.2 GB—✕ Won't fit
Qwen 3.6 27B27BQ4_K_M18.5 GB—✕ Won't fit
Qwen 3.6 35B-A3B35BQ4_K_M23.9 GB—✕ Won't fit
Gemma 4 26B-A4B26BQ4_017.5 GB—✕ Won't fit
Nemotron 3 Nano 30B-A3B30BQ4_K_M28.5 GB—✕ Won't fit
Nemotron 3 Nano Omni 30B-A3B31BQ4_K_M26.3 GB—✕ Won't fit
Nemotron 3.5 Lightning 30B-A3B30BQ8_035.9 GB—✕ Won't fit
GPT-OSS 20B21BMXFP414.8 GB—✕ Won't fit
Ornith 1.0 35B-A3B35BQ4_K_M25.3 GB—✕ Won't fit
XYZ-Aquila mini 35B-A3B35BQ4_K_M25.5 GB—✕ Won't fit
Salience 1.5 Flash30BQ4_K_M22.3 GB—✕ Won't fit
Fara 1.5 27B27BQ4_K_M20.9 GB—✕ Won't fit
KAT-Coder V2.5 Dev35BQ4_K_M25.5 GB—✕ Won't fit
BigBang V1 36B-A3B36BQ4_K_M26.1 GB—✕ Won't fit
Muse Glimmer 30B29.6BK_QUANT_17GB20.3 GB—✕ Won't fit
Qwen3.8 27B27BQ4_K_M20.8 GB—✕ Won't fit
Qwen3.8 2.4T-A95B2400BIQ4_XS1377.4 GB—✕ Won't fit
UI-Mate 27B27BQ4_K_M20.9 GB—✕ Won't fit
GLM-4.5V106BQ4_K_M74.8 GB—✕ Won't fit
GLM-4.5-Air106BQ4_K_M74.8 GB—✕ Won't fit
Granite 4.2 30B30BQ4_K_M21.3 GB—✕ Won't fit
Apodex 1.1 Mini35BQ4_K_M26 GB—✕ Won't fit
Ling 3.0 Flash124BQ4_K_M82.3 GB—✕ Won't fit
Qwen3.8-Flash-Next125BIQ4_XS107.7 GB—✕ Won't fit
GLM-5.3744BQ4_K_XL543.3 GB—✕ Won't fit
GLM-5.3-Flash320BQ4_K_XL232.7 GB—✕ Won't fit
Llama 3.3 70B70BQ4_K_M50.1 GB—✕ Won't fit
Qwen3 32B32.8BQ4_K_M23.7 GB—✕ Won't fit
Ornith 1.0 397B397BQ4_K_M285.6 GB—✕ Won't fit
Gemma 4 31B31BQ4_K_M22 GB—✕ Won't fit
Hunyuan 3 (Hy3)298.8BQ4_K_M212.8 GB—✕ Won't fit
DeepSeek V4 Flash 0731284BQ4_K_XL163.6 GB—✕ Won't fit
Inkling952.4BQ8_0966.9 GB—✕ Won't fit
Inkling Small276BQ4_K_M190.5 GB—✕ Won't fit
LongCat Flash Chat561.9BIQ1_S159.6 GB—✕ Won't fit
Laguna XS 2.133BQ4_K_M24.2 GB—✕ Won't fit
Laguna S 2.1118BQ4_K_M109.7 GB—✕ Won't fit

~ = bandwidth-based estimate · ✓ = measured on real hardware

Best model by use case

Best for Chat
Qwen3 0.6B

Top everyday assistant & writing pick here — ~45 tokens/s at Q8_0, using 1.3 of ~5.2GB.

Best for Coding
G9v3 3B

Top code completion & explain-this pick here — ~14.2 tokens/s at Q4_K_M, using 2.8 of ~5.2GB.

Best for Reasoning
DeepSeek R1 Distill 1.5B

Top math & step-by-step thinking pick here — ~24.5 tokens/s at Q4_K_M, using 1.9 of ~5.2GB.

FAQ

What is the biggest AI model the iPhone 16e can run?

Bonsai 27B (1-bit) (27B parameters) at Q1_0 — it needs 4.8GB of the ~5.2GB usable on the 8GB iPhone 16e, at ~7.1 tokens/s.

How much of the iPhone 16e's 8GB RAM can AI models actually use?

About 5.2GB. iOS caps a single app at roughly 65% of total RAM, so of the 8GB about 5.2GB is actually available to a model.

Can the iPhone 16e run Llama 3.1 8B?

Not at Q4_K_M: it needs 6.3GB but the iPhone 16e only has ~5.2GB usable. Try a smaller model like Qwen3 0.6B.

How fast is local AI on the iPhone 16e?

The Apple A18 has 60GB/s of memory bandwidth, which is what decode speed scales with. Small models like Ternary Bonsai 1.7B reach ~54 tokens/s; larger 7–14B models land in the single digits. Anything above ~8 tokens/s feels smooth for chat.

Which quantization should I use on the iPhone 16e?

Q4_K_M is the size/quality sweet spot for most models. For example, Qwen3 0.6B at Q8_0 takes 1.3GB of memory here. Only drop to Q3 or IQ4 if a model just misses fitting; Q8 rarely pays off on 8GB of RAM.

Is 8GB of RAM enough for local AI?

29 of the 93 models we track fit on the iPhone 16e — 28 run great and 1 run with compromises. 64 models (mostly 12B+) don't fit at their recommended quant.

Other Apple phones

iPhone 16 Pro MaxiPhone 16 ProiPhone 16iPhone 15 ProiPhone 15iPhone 14iPhone 17iPhone AiriPhone 17 ProiPhone 17 Pro MaxiPhone 17e