5 ms·
Whisper Turbo: transcribe 20x faster than realtime using Rust and WebGPU
- mmastrac 3y agoWhere is the Rust portion of the project? It appears to be named Rumble.
- deleted 3y ago[deleted]
- FL33TW00D 3y agoClosed source as of now, I am working on this full time.
- theusus 3y agoLooks like just the website wrapper. Where is the code?
- lhl 3y agoNeat to see a new implementation, although I'll note that for those looking for a drop-in replacement for the whisper library, I believe that both https://github.com/guillaumekln/faster-whisper https://github.com/guillaumekln/faster-whisper and https://github.com/m-bain/whisperX https://github.com/m-bain/whisperX are easier (PyTorch-based, doesn't require a web browser), and a lot faster (WhisperX is up to 70X realtime).
- claytonjy 3y agoYeah exactly, 20x is on the high side these days. That's 1.5s for 30s of input, a bit slower than I get for ctranslate2 alone (basis for faster-whisper and whisperX) on a V100 with the large model and beam size 5.
- FL33TW00D 3y agoLarge-V2 is only 2x faster than realtime on my M1 7 core GPU. 20x is for smaller variants.
- FL33TW00D 3y agoNeither faster-whisper or whisperX can be used in the browser or as an NPM package right?
- iandanforth 3y agoVercel demo doesn't work in Firefox: "TypeError: i[e] is undefined" and "No Model Loaded" error after loading and picking a file and pressing transcribe.
- FL33TW00D 3y agoFirefox has not shipped WebGPU yet. Try it on Chrome.