3 ms·
Wonder if they'll eventually release Whisper support. Groq has been great for transcribing 1hr+ calls at a significnatly lower price compared to OpenAI ($0.36/h
by obviyus 2y ago
Wonder if they'll eventually release Whisper support. Groq has been great for transcribing 1hr+ calls at a significnatly lower price compared to OpenAI ($0.36/hr vs. $0.04/hr).
- Arn_Thor 2y agoWhisper runs so well locally on any hardware I’ve thrown at it, why run it in the cloud?
- swores 2y agoDoes it run well on CPU? I've used it locally but only with my high end (consumer/gaming) GPU, and haven't got round to finding out how it does on weaker machines.
- Arn_Thor 2y agoIt’s not fast but if your transcript doesn’t have to get out ASAP it’s fine
- obviyus 2y agoThat's pretty much exactly how I started. Ran whisper.cpp locally for a while on a 3070Ti. It worked quite well when n=1. For our use case, we may get 1 audio file at a time, we may get 10. Of course queuing them is possible but we decided to prioritize speed & reliability over self hosting.
- Arn_Thor 2y agoGot it. Makes sense in that context
- BrunoJo 2y agohttps://Lemonfox.ai https://Lemonfox.ai is another alternative to OpenAI's Whisper API if you need support for word-level timestamps and diarization.