4 ms·
Insanely Fast Whisper API Deployable to Fly GPU
- 2Gkashmiri 2y agoIs there a commercially available whisper api or you have to use it locally only ?
- waldrews 2y agoOpenAI's speech to text API is the official Whisper implementation. It's expensive. Many small providers will host Whisper as an endpoint (Replicate for example). Groq has Whisper in a private beta; if they open it up for commercial usage, cheap and fast, that'll be a game changer.
- arthurdelerue 2y agoNLP Cloud is a good example of a smaller provider that proposes a good Whisper implementation (no downtimes and relatively cheap): https://nlpcloud.com/nlp-automatic-speech-recognition-speech-to-text-api.html https://nlpcloud.com/nlp-automatic-speech-recognition-speech...
- brianjking 2y agoBeautiful, would love a way to deploy this easily on Huggingface Inference Endpoints. The need for a custom handler.py has always stopped me from doing so.