3 ms·
It runs locally, using Whisper.cpp[1], a Whisper implementation optimized to run on CPU, especially Apple Silicon. Whisper itself is open source, and so is tha
by miki123211 3y ago
It runs locally, using Whisper.cpp[1], a Whisper implementation optimized to run on CPU, especially Apple Silicon.
Whisper itself is open source, and so is that implementation, the OpenAI endpoint is merely a convenience to those who don't wish to host a Whisper server themselves, deal with batching, renting GPUs etc. If you're making a commercial service based on Whisper, the API might be worth it for the convenience, but if you're running it personally and have a good enough machine (an M1 MacBook Air will do), running it locally is usually better.
[1] https://github.com/ggerganov/whisper.cpp https://github.com/ggerganov/whisper.cpp
- smoldesu 3y agoFWIW, I will add that most laptops made in the past 10 years are fast enough for real-time transcription. Unless you're trying to transcribe in bulk, running it locally will usually be the best option.
- miki123211 3y agoThis depends on the model being used, if you're doing anything which isn't English, you pretty much need large, and that needs considerable resources.