3 ms·
Whisper runs so well locally on any hardware I’ve thrown at it, why run it in the cloud?
by Arn_Thor 2y ago
Whisper runs so well locally on any hardware I’ve thrown at it, why run it in the cloud?
- swores 2y agoDoes it run well on CPU? I've used it locally but only with my high end (consumer/gaming) GPU, and haven't got round to finding out how it does on weaker machines.
- Arn_Thor 2y agoIt’s not fast but if your transcript doesn’t have to get out ASAP it’s fine
- obviyus 2y agoThat's pretty much exactly how I started. Ran whisper.cpp locally for a while on a 3070Ti. It worked quite well when n=1. For our use case, we may get 1 audio file at a time, we may get 10. Of course queuing them is possible but we decided to prioritize speed & reliability over self hosting.
- Arn_Thor 2y agoGot it. Makes sense in that context