Qwen3.8 Squeezed to 11.8 GB Runs at 150 Tokens per Second
A community remix packs an uncensored 27B Qwen into 11.8 GB by giving each of 851 tensors its own quantization type, hitting 100+ tokens per second on a 16 GB card.
Source
AlphaSignal
Published
Author
AlphaSignal Newsroom
Read
1 min read
A community remix packs an uncensored 27B Qwen into 11.8 GB by giving each of 851 tensors its own quantization type, hitting 100+ tokens per second on a 16 GB card.
Reporting is indexed from AlphaSignal. Rights remain with the original publisher and cited sources.
