hermes-ai.net

Read docs →
HermesHermes Agent Docs
Back to News

Edge0 Runs a 35B AI Model on an iPhone With Just 2.9 GiB

Edge0 streams a 35B Mixture-of-Experts model from SSD on an iPhone, holding under 3 GB of active RAM while decoding at 15 tokens per second.

Edge0 Runs a 35B AI Model on an iPhone With Just 2.9 GiB
Source
AlphaSignal
Published
Author
AlphaSignal Newsroom
Read
1 min read

Edge0 streams a 35B Mixture-of-Experts model from SSD on an iPhone, holding under 3 GB of active RAM while decoding at 15 tokens per second.

Reporting is indexed from AlphaSignal. Rights remain with the original publisher and cited sources.

Read original report