hermes-ai.net

Read docs →
HermesHermes Agent Docs
Back to News

Qwen3.8 Squeezed to 11.8 GB Runs at 150 Tokens per Second

A community remix packs an uncensored 27B Qwen into 11.8 GB by giving each of 851 tensors its own quantization type, hitting 100+ tokens per second on a 16 GB card.

Qwen3.8 Squeezed to 11.8 GB Runs at 150 Tokens per Second
Source
AlphaSignal
Published
Author
AlphaSignal Newsroom
Read
1 min read

A community remix packs an uncensored 27B Qwen into 11.8 GB by giving each of 851 tensors its own quantization type, hitting 100+ tokens per second on a 16 GB card.

Reporting is indexed from AlphaSignal. Rights remain with the original publisher and cited sources.

Read original report