4 ms·

I’ve gotten confused between the different whispers. How is this different from the openai api endpoint?

• miki123211 3y ago
  It runs locally, using Whisper.cpp[1], a Whisper implementation optimized to run on CPU, especially Apple Silicon. Whisper itself is open source, and so is that implementation, the OpenAI endpoint is merely a convenience to those who don't wish to host a Whisper server themselves, deal with batching, renting GPUs etc. If you're making a commercial service based on Whisper, the API might be worth it for the convenience, but if you're running it personally and have a good enough machine (an M1 MacBook Air will do), running it locally is usually better. [1] https://github.com/ggerganov/whisper.cpp https://github.com/ggerganov/whisper.cpp
  • smoldesu 3y ago
    FWIW, I will add that most laptops made in the past 10 years are fast enough for real-time transcription. Unless you're trying to transcribe in bulk, running it locally will usually be the best option.
    • miki123211 3y ago
      This depends on the model being used, if you're doing anything which isn't English, you pretty much need large, and that needs considerable resources.