3 ms·
Depends what you mean by “fast”. I’ve tested WhisperLive, it’s basically real-time (i.e. low latency).
by tomp 2y ago
Depends what you mean by “fast”.
I’ve tested WhisperLive, it’s basically real-time (i.e. low latency).
- gunalx 2y agoDosent whisperlive just use faster-whisper under the hood. Witch can be way faster than real time.
- tomp 2y agoThere's a difference between speed & latency when it comes to performance. Faster-whisper can process audio faster than real-time, but AFAIK vanilla Whisper needs a few seconds long audio "frame" to do inference/STT. Whisper Live fixes that, and reduces latency to a few tens/hundreds of ms.
- gcr 2y agoWhat sort of performance are you needing? My Apple M1 MacBook (2021) can infer whisper-medium at roughly 10x realtime, for comparison. Takes about 20min to process three hours of audio.