ChatR Labs Shrinks Alibaba's Qwen-Image-2.1 to 4 GB for Consumer GPUs
ChatR Labs released a quantized Qwen-Image-2.1 with a rank-128 Omni LoRA merged at strength 1.0. Thirteen builds ship: GGUF, FP8, INT8 ConvRot, NVFP4, NF4 bitsandbytes, FP8 torchao, and BF16 safetensors. NVFP4 runs at about 4 GB VRAM; Q5_K_M at 8 GB; BF16 at 14 GB on RTX 5090.
Source
AlphaSignal
Published
Author
AlphaSignal
Read
1 min read
Takeaways
ChatR Labs released a quantized Qwen-Image-2.1 with a rank-128 Omni LoRA merged at strength 1.0.