4 ms·
There's a difference between speed & latency when it comes to performance. Faster-whisper can process audio faster than real-time, but AFAIK vanilla Whisper ne
by tomp 2y ago
There's a difference between speed & latency when it comes to performance.
Faster-whisper can process audio faster than real-time, but AFAIK vanilla Whisper needs a few seconds long audio "frame" to do inference/STT.
Whisper Live fixes that, and reduces latency to a few tens/hundreds of ms.
- gcr 2y agoWhat sort of performance are you needing? My Apple M1 MacBook (2021) can infer whisper-medium at roughly 10x realtime, for comparison. Takes about 20min to process three hours of audio.