Edge0 is an open source framework that streams MoE experts from SSD, letting a 35B parameter model run on a 24GB Mac mini with under 3GB active memory.
Source
AlphaSignal
Published
Author
AlphaSignal Newsroom
Read
1 min read
Edge0 is an open source framework that streams MoE experts from SSD, letting a 35B parameter model run on a 24GB Mac mini with under 3GB active memory.
Reporting is indexed from AlphaSignal. Rights remain with the original publisher and cited sources.