DeepSeek-V4.1-Flash's 748B Model Now Runs on a Single RTX 5090
A community quantization shrinks DeepSeek's 748B mixture-of-experts to 178GB, letting Project Maya run it on a single consumer GPU by streaming experts from SSD.
Source
AlphaSignal
Published
Author
AlphaSignal Newsroom
Read
1 min read
A community quantization shrinks DeepSeek's 748B mixture-of-experts to 178GB, letting Project Maya run it on a single consumer GPU by streaming experts from SSD.
Reporting is indexed from AlphaSignal. Rights remain with the original publisher and cited sources.