aicanrun

AI Models for OnePlus 13 — What runs on 24GB

34 great · 23 slow · 36 won't fit
Chip
Snapdragon 8 Elite
Memory bandwidth
76.8 GB/s
NPU
45 TOPS
RAM options
12 / 16 / 24 GB
Usable for models
~20 GB
Year
2024

Specs checked against manufacturer and public documentation on .

What runs on the OnePlus 13

All 93 models at their recommended quant, on the 24GB configuration. Select any row for the full report.

ModelParamsQuantNeedsSpeedVerdict
Qwen3 0.6B0.6BQ8_01.3 GB~57.6 tokens/s✓ Runs great
Qwen3 1.7B1.7BQ8_02.6 GB~19.2 tokens/s✓ Runs great
Llama 3.2 1B1.2BQ4_K_M1.5 GB~43.2 tokens/s✓ Runs great
Llama 3.2 3B3.2BQ4_K_M2.9 GB~17.3 tokens/s✓ Runs great
Gemma 3 1B1BQ4_K_M1.5 GB~43.2 tokens/s✓ Runs great
DeepSeek R1 Distill 1.5B1.8BQ4_K_M1.9 GB~31.4 tokens/s✓ Runs great
SmolLM2 1.7B1.7BQ4_K_M1.9 GB~31.4 tokens/s✓ Runs great
SmolLM3 3B3.1BQ4_K_M2.8 GB~18.2 tokens/s✓ Runs great
Qwen 3.5 2B2BQ4_K_M2.1 GB~26.6 tokens/s✓ Runs great
Gemma 4 26B-A4B26BQ4_017.5 GB~15.6 tokens/s✓ Runs great
Ternary Bonsai 8B8BQ2_03.5 GB~15.7 tokens/s✓ Runs great
Ternary Bonsai 4B4BQ2_02 GB~31.4 tokens/s✓ Runs great
Ternary Bonsai 1.7B1.7BQ2_01.2 GB~69.1 tokens/s✓ Runs great
Ministral 3 3B3BQ4_K_M3 GB~16.5 tokens/s✓ Runs great
LFM2.5 2.6B2.7BQ4_K_M2.6 GB~20.3 tokens/s✓ Runs great
LFM2.5 8B-A1B8BQ4_K_M6.6 GB~53.2 tokens/s✓ Runs great
LFM2.5-VL 3B3.1BQ4_K_M2.6 GB~20.3 tokens/s✓ Runs great
GPT-OSS 20B21BMXFP414.8 GB~16.7 tokens/s✓ Runs great
OvisOCR2 0.8B0.8BQ4_K_M1.3 GB~57.6 tokens/s✓ Runs great
G9v3 3B3BQ4_K_M2.8 GB~18.2 tokens/s✓ Runs great
Tini Cybersec 8B-A1B8.5BQ4_K_M6.7 GB~56.5 tokens/s✓ Runs great
Ling 3.0 Tiny7.9BQ4_K_M6.3 GB~39.8 tokens/s✓ Runs great
Granite 4.2 3B3BQ4_K_M3.1 GB~15.7 tokens/s✓ Runs great
Qwen3 4B4BQ4_K_M3.5 GB~13.8 tokens/s✓ Runs great
Gemma 3 4B4.3BQ4_K_M3.5 GB~13.8 tokens/s✓ Runs great
Phi-4 Mini 3.8B3.8BQ4_K_M3.5 GB~13.8 tokens/s✓ Runs great
Qwen 3.5 4B4BQ4_K_M3.7 GB~12.8 tokens/s✓ Runs great
Agents-A1 4B4BQ4_K_M3.7 GB~12.8 tokens/s✓ Runs great
Nanbeige 4.2 3B4.2BQ4_K_M3.7 GB~12.8 tokens/s✓ Runs great
Nemotron 3 Nano 4B4BQ4_K_M3.8 GB~12.3 tokens/s✓ Runs great
AREX Turbo 4B4.5BQ4_K_M4 GB~11.9 tokens/s✓ Runs great
Fara 1.5 4B4.5BQ4_K_M4 GB~11.9 tokens/s✓ Runs great
Gemma 4 E2B2BQ4_K_M4 GB~11.1 tokens/s✓ Runs great
Bonsai 27B (1-bit)27BQ1_04.8 GB~9.1 tokens/s✓ Runs great
Mistral 7B v0.37.2BQ4_K_M5.7 GB~7.9 tokens/s! Runs, barely
DeepSeek R1 Distill 7B7.6BQ4_K_M6.1 GB~7.4 tokens/s! Runs, barely
Llama 3.1 8B8BQ4_K_M6.3 GB~7.1 tokens/s! Runs, barely
Ministral 8B8BQ4_K_M6.3 GB~7.1 tokens/s! Runs, barely
Qwen3 8B8.2BQ4_K_M6.4 GB~6.9 tokens/s! Runs, barely
Gemma 4 E4B4BQ4_K_M6.1 GB~6.9 tokens/s! Runs, barely
Ministral 3 8B8BQ4_K_M6.6 GB~6.6 tokens/s! Runs, barely
Ornith 1.0 9B9BQ4_K_M7.1 GB~6.2 tokens/s! Runs, barely
Granite 4.2 8B8BQ4_K_M6.7 GB~6.5 tokens/s! Runs, barely
Qwen 3.5 9B9BQ4_K_M7.2 GB~6.1 tokens/s! Runs, barely
GRM 3.2 Cliff 9B9.4BQ4_K_M7.5 GB~5.9 tokens/s! Runs, barely
Qwythos 9B v29BQ4_K_M7.2 GB~6.1 tokens/s! Runs, barely
grug 9B (ProCreations)9.4BQ4_K_M7.5 GB~5.9 tokens/s! Runs, barely
Fara 1.5 9B9.4BQ4_K_M7.5 GB~5.9 tokens/s! Runs, barely
UI-Mate 9B9BQ4_K_M7.4 GB~5.9 tokens/s! Runs, barely
Gemma 3 12B12.2BQ4_K_M9.1 GB~4.7 tokens/s! Runs, barely
Gemma 4 12B12BQ4_08.8 GB~4.9 tokens/s! Runs, barely
Ternary Bonsai 27B27BQ2_08.4 GB~4.8 tokens/s! Runs, barely
Grug 12B12BQ4_K_M9.5 GB~4.5 tokens/s! Runs, barely
Ministral 3 14B14BQ4_K_M10.2 GB~4.2 tokens/s! Runs, barely
Qwen3 14B14.8BQ4_K_M11.1 GB~3.8 tokens/s! Runs, barely
Phi-4 14B14.7BQ4_K_M11.2 GB~3.8 tokens/s! Runs, barely
Qwen 3.6 27B27BQ4_K_M18.5 GB~2.1 tokens/s! Runs, barely
Qwen 3.5 27B27BQ4_K_M20 GB—✕ Won't fit
Muse Glimmer 30B29.6BK_QUANT_17GB20.3 GB—✕ Won't fit
Fara 1.5 27B27BQ4_K_M20.9 GB—✕ Won't fit
Qwen3.8 27B27BQ4_K_M20.8 GB—✕ Won't fit
UI-Mate 27B27BQ4_K_M20.9 GB—✕ Won't fit
Granite 4.2 30B30BQ4_K_M21.3 GB—✕ Won't fit
Qwen3 30B A3B30.5BQ4_K_M22.3 GB—✕ Won't fit
Gemma 4 31B31BQ4_K_M22 GB—✕ Won't fit
Salience 1.5 Flash30BQ4_K_M22.3 GB—✕ Won't fit
Qwen 3.6 35B-A3B35BQ4_K_M23.9 GB—✕ Won't fit
Qwen3 32B32.8BQ4_K_M23.7 GB—✕ Won't fit
Laguna XS 2.133BQ4_K_M24.2 GB—✕ Won't fit
Ornith 1.0 35B-A3B35BQ4_K_M25.3 GB—✕ Won't fit
XYZ-Aquila mini 35B-A3B35BQ4_K_M25.5 GB—✕ Won't fit
KAT-Coder V2.5 Dev35BQ4_K_M25.5 GB—✕ Won't fit
Qwen 3.5 35B-A3B35BQ4_K_M26.2 GB—✕ Won't fit
Nemotron 3 Nano Omni 30B-A3B31BQ4_K_M26.3 GB—✕ Won't fit
BigBang V1 36B-A3B36BQ4_K_M26.1 GB—✕ Won't fit
Apodex 1.1 Mini35BQ4_K_M26 GB—✕ Won't fit
Nemotron 3 Nano 30B-A3B30BQ4_K_M28.5 GB—✕ Won't fit
Nemotron 3.5 Lightning 30B-A3B30BQ8_035.9 GB—✕ Won't fit
Qwen3.8 2.4T-A95B2400BIQ4_XS1377.4 GB—✕ Won't fit
GLM-4.5V106BQ4_K_M74.8 GB—✕ Won't fit
GLM-4.5-Air106BQ4_K_M74.8 GB—✕ Won't fit
Ling 3.0 Flash124BQ4_K_M82.3 GB—✕ Won't fit
Qwen3.8-Flash-Next125BIQ4_XS107.7 GB—✕ Won't fit
GLM-5.3744BQ4_K_XL543.3 GB—✕ Won't fit
GLM-5.3-Flash320BQ4_K_XL232.7 GB—✕ Won't fit
Llama 3.3 70B70BQ4_K_M50.1 GB—✕ Won't fit
Ornith 1.0 397B397BQ4_K_M285.6 GB—✕ Won't fit
Hunyuan 3 (Hy3)298.8BQ4_K_M212.8 GB—✕ Won't fit
DeepSeek V4 Flash 0731284BQ4_K_XL163.6 GB—✕ Won't fit
Inkling952.4BQ8_0966.9 GB—✕ Won't fit
Inkling Small276BQ4_K_M190.5 GB—✕ Won't fit
LongCat Flash Chat561.9BIQ1_S159.6 GB—✕ Won't fit
Laguna S 2.1118BQ4_K_M109.7 GB—✕ Won't fit

~ = bandwidth-based estimate · ✓ = measured on real hardware

Best model by use case

Best for Chat
Qwen3 0.6B

Top everyday assistant & writing pick here — ~57.6 tokens/s at Q8_0, using 1.3 of ~20GB.

Best for Coding
G9v3 3B

Top code completion & explain-this pick here — ~18.2 tokens/s at Q4_K_M, using 2.8 of ~20GB.

Best for Reasoning
DeepSeek R1 Distill 1.5B

Top math & step-by-step thinking pick here — ~31.4 tokens/s at Q4_K_M, using 1.9 of ~20GB.

FAQ

What is the biggest AI model the OnePlus 13 can run?

Bonsai 27B (1-bit) (27B parameters) at Q1_0 — it needs 4.8GB of the ~20GB usable on the 24GB OnePlus 13 and runs at ~9.1 tokens/s.

How much of the OnePlus 13's 24GB RAM can AI models actually use?

About 20GB. Android keeps roughly 2–4GB for the system and resident apps, so of the 24GB about 20GB is actually available to a model.

Can the OnePlus 13 run Llama 3.1 8B?

Yes — at Q4_K_M it needs 6.3GB of the ~20GB usable and runs at ~7.1 tokens/s.

How fast is local AI on the OnePlus 13?

The Snapdragon 8 Elite has 76.8GB/s of memory bandwidth, which is what decode speed scales with. Small models like Ternary Bonsai 1.7B reach ~69.1 tokens/s; larger 7–14B models land in the single digits. Anything above ~8 tokens/s feels smooth for chat.

Which quantization should I use on the OnePlus 13?

Q4_K_M is the size/quality sweet spot for most models. For example, Qwen3 0.6B at Q8_0 takes 1.3GB of memory here. Only drop to Q3 or IQ4 if a model just misses fitting; Q8 rarely pays off on 24GB of RAM.

Is 24GB of RAM enough for local AI?

57 of the 93 models we track fit on the OnePlus 13 — 34 run great and 23 run with compromises. 36 models (mostly 12B+) don't fit at their recommended quant.

Other OnePlus phones

OnePlus 12OnePlus 15OnePlus 13ROnePlus 15ROnePlus Open