AgentionAI's Gyro-Coder Squeezes a 125B Coding Model onto a 24GB GPU
A 125B mixture-of-experts coding model squeezed onto a single 24GB consumer GPU through evolutionary expert pruning and 2.125-bit trellis quantization.
Source
AlphaSignal
Published
Author
AlphaSignal Newsroom
Read
1 min read
A 125B mixture-of-experts coding model squeezed onto a single 24GB consumer GPU through evolutionary expert pruning and 2.125-bit trellis quantization.
Reporting is indexed from AlphaSignal. Rights remain with the original publisher and cited sources.
