Handy Computer Shrinks Parakeet Ultra to 486 MB for Python-Free Transcription
Parakeet Ultra now available as GGUF quantizations for transcribe.cpp, from F32 (2.51 GB) to Q4_K_M (486 MB). Q4_K_M quant hits 1.82% WER on LibriSpeech test-clean vs 1.80% for F32, near-lossless compression.
Source
AlphaSignal
Published
Author
AlphaSignal
Read
1 min read
Takeaways
Parakeet Ultra now available as GGUF quantizations for transcribe.cpp, from F32 (2.51 GB) to Q4_K_M (486 MB).
Q4_K_M quant hits 1.82% WER on LibriSpeech test-clean vs 1.80% for F32, near-lossless compression.
Covers 25 European languages with FastConformer encoder and TDT transducer decoder, 0.6B parameters.
Built-in voice-activity head segments long audio at pauses into chunks of max 30 seconds, no external VAD needed.
Upstream Ultra cuts FLEURS 25-language WER from 11.62% to 9.55% vs base parakeet-tdt-0.6b-v3.
CC-BY-4.0 license, 16 kHz mono WAV input, not streaming, does not translate.
Handy Computer has released six GGUF builds of Parakeet Ultra for transcribe.cpp . The port runs local speech recognition from one C++ executable and one model file, without Python, a CUDA runtime, or a cloud request. Files range from a 2.51 GB F32 build to a 486 MB Q4_K_M quantized version.
Precision
File size
WER
Difference from F32
F32
2.51 GB
1.80%
Reporting is indexed from AlphaSignal. Rights remain with the original publisher and cited sources.
