4 ms·
There have been a lot of hacks to speed up whisper inference
by jerpint 4y ago
There have been a lot of hacks to speed up whisper inference
- skim_milk 4y agoSweet! Do you have any links to resources on how to speed it up? I couldn't find any while searching Google or the Whisper discussion forums.
- EMIRELADERO 4y agoNot a hack per se but a complete reimplementation. https://github.com/ggerganov/whisper.cpp https://github.com/ggerganov/whisper.cpp This is a C/C++ version of Whisper which uses the CPU. It's astoundingly fast. Maybe it won't work in your use case, but you should try!