vLLM-Omni Now Serves Fish Audio's Drama 3 at 128 Concurrent Streams

vLLM-Omni now serves Fish Audio's 35B directable TTS model with 128 concurrent streams on one H200 and 255 ms median time to first audio.

Source

vLLM

Published

Oct 15, 2026, 8:39 AM

Author

AlphaSignal Newsroom

Read

1 min read

vLLM-Omni now serves Fish Audio's 35B directable TTS model with 128 concurrent streams on one H200 and 255 ms median time to first audio.

Reporting is indexed from AlphaSignal. Rights remain with the original publisher and cited sources.

Next reads