Can I run OneJev 9B locally?

At Q4_K_M, the tracked weights are 5.6GB. The tables estimate memory fit, not app support or decision latency. OneJev needs the publisher's System One workflow; image inputs need additional projector memory.

How to run OneJev 9B locally

OneJev returns probabilities for typed choices in a single forward pass. The hardware tables below estimate weight fit; chat tokens/s do not measure decision latency. Image inputs also require a separate vision projector, whose memory is not included in the GGUF weight figures.

The publisher documents qev with llama.cpp for text and images. Video requires its PyTorch server. This is a developer workflow; the phone tables do not establish PocketPal support.

brew install llama.cpp
pip install git+https://github.com/OmniJev/OneJev.git
qev serve --gguf mradermacher/OneJev-9B-GGUF:Q8_0

This upstream example uses Q8_0, not the default Q4_K_M estimate. Allow additional memory for the projector and runtime before choosing hardware.

Publisher setup and System One client example ↗
Params
9B
Family
onejev
Released
2026-09
Tags
vision · reasoning

Downloads & memory by quant

The download is only the weights — add KV cache and runtime to get what your phone actually needs. “Memory-fit” only means it can load; “usable” also requires an estimated 3+ tokens/s. Each row uses that row's quant. ★ = recommended.

QuantDownloadMemory neededPhone reality
Q2_K3.8 GB~5.2 GB138 memory-fit · 126 usable
Q3_K_M4.6 GB~6.1 GB113 memory-fit · 99 usable
IQ4_XS5.2 GB~6.7 GB113 memory-fit · 98 usable
Q4_K_S5.4 GB~6.9 GB113 memory-fit · 97 usable
Q4_K_M ★5.6 GB~7.1 GB113 memory-fit · 97 usable
Q5_K_M6.5 GB~8.1 GB110 memory-fit · 94 usable
Q6_K7.4 GB~9 GB110 memory-fit · 94 usable
Q8_09.5 GB~11.2 GB66 memory-fit · 66 usable

OneJev 9B at Q4_K_M on 150 phones

This table is fixed to the recommended Q4_K_M, on each phone's largest RAM option. Counts for smaller quants above will differ. All phones are shown, sorted by fit and estimated experience; tap one for the full report.

PhoneChip · RAMNeedsSpeedVerdict

~ = bandwidth-based estimate · ✓ = measured on real hardware

OneJev 9B on 54 Mac configurations

Each Mac uses the recommended Q4_K_M at 4K context when it fits, or the largest smaller tracked quant that fits. Each row links to the full report with a macOS-specific setup guide.

MacUnified memoryQuantWorking budgetNeedsEstimated speedVerdict

FAQ

How much RAM do I need to run OneJev 9B on a phone?

At Q4_K_M, OneJev 9B needs ~7.1GB of usable memory (weights + KV cache + runtime). In practice that means a 12GB+ Android phone or a 12GB+ iPhone — iOS lets a single app use less of its RAM than Android does.

How fast does OneJev 9B run on a flagship phone?

OneJev scores typed decisions in a single forward pass. The tables estimate weight memory and generic decode throughput, not measured decision latency. A phone memory fit does not establish support for the qev workflow.

Can an iPhone run OneJev 9B?

OneJev is a developer decision model that needs the publisher's qev server and System One client. AICanRun has not verified an iPhone app route. Images require additional projector memory.

What is the best quantization of OneJev 9B for mobile?

Q4_K_M (5.6GB download) is the size/quality sweet spot of the 8 quants available. Total memory needed is ~7.1GB once the KV cache and runtime are counted — the download size alone understates it.

How many phones can run OneJev 9B?

OneJev scores typed decisions in a single forward pass. The tables estimate weight memory and generic decode throughput, not measured decision latency. A phone memory fit does not establish support for the qev workflow.

Which Macs can run OneJev 9B?

52 of the 54 exact Mac configurations we track have enough estimated working memory. Each Mac uses the recommended Q4_K_M when it fits, or the largest smaller tracked quant that fits, and separates installed unified memory, the macOS reserve, and estimated speed.

What is OneJev 9B good for on a phone?

OneJev is a developer decision model that needs the publisher's qev server and System One client. AICanRun has not verified an iPhone app route. Images require additional projector memory.

Similar models

OneJev 0.8BOneJev 4BOneJev 27BQwen 3.5 9BOrnith 1.0 9B