Can OneJev 9B run on MacBook Neo A18 Pro 8GB?

Weights exceed the memory budget · custom workflow
Q4_K_M · 4K context · formula estimate

What this means

The checked Q4_K_M build needs about 7.3GB, above this Mac's conservative 5GB working budget.

OneJev scores typed decisions in one forward pass. Generic decode estimates are not decision latency; image inputs need additional projector memory. Use the publisher's qev server and System One client.

Not measured
decision latency
7.3GB
needed at Q4_K_M
Q4_K_M
quant selected
0GB
working headroom
needs 7.3 GBworking budget 5 GB · short 2.3 GB
Apple A18 Pro8 GB unified memoryMetalFanless

Where the memory goes

ComponentDetailGB
Model weightsQ4_K_M GGUF (5.6 GB) + mmap overhead5.9
KV cache4K context window0.6
RuntimemacOS inference app + compute buffers0.8
Total neededat Q4_K_M, 4K context7.3
Working budget8 GB unified memory − conservative macOS reserve5
Headroommemory shortfall−2.3

Pick your quant

QuantDownloadMemoryEstimated speedVerdict
Q2_K3.8 GB5.4 GB—✕ Won't fit
Q3_K_M4.6 GB6.3 GB—✕ Won't fit
IQ4_XS5.2 GB6.9 GB—✕ Won't fit
Q4_K_S5.4 GB7.1 GB—✕ Won't fit
Q4_K_M ★5.6 GB7.3 GB—✕ Won't fit
Q5_K_M6.5 GB8.3 GB—✕ Won't fit
Q6_K7.4 GB9.2 GB—✕ Won't fit
Q8_09.5 GB11.4 GB—✕ Won't fit

Other models on this Mac

FAQ

Can the MacBook Neo A18 Pro · 8GB run OneJev 9B?

The tracked Q4_K_M working memory is estimated at 7.3GB, excluding the vision projector. Weight fit is not verified workflow support; use the publisher's qev server and System One client.

Which OneJev 9B quant should I use on this Mac?

None of the tracked quants fit this configuration safely. Choose a smaller model or a Mac with more unified memory.

Which app should I use for OneJev 9B on this Mac?

OneJev 9B is a task-specific model, not a normal local chat download. The selected weights do not fit this Mac, and the model also needs its publisher's intended workflow. This page links that repository and recommends Llama 3.2 3B if you just want local chat.

Are these speeds measured on a MacBook Neo A18 Pro?

Decision latency has not been measured. OneJev scores typed choices in one forward pass; generic decode estimates do not measure this workflow.