4 ms·
Whisper can be run on CPUs and produce high-quality transcripts. Doing it on CPU is like a 10th the price and more horizontally scalable. This is using CPUs: h
by thundergolfer 4y ago
Whisper can be run on CPUs and produce high-quality transcripts. Doing it on CPU is like a 10th the price and more horizontally scalable.
This is using CPUs: https://modal-labs--whisper-pod-transcriber-fastapi-app.modal.run/ https://modal-labs--whisper-pod-transcriber-fastapi-app.moda....
Transcribes a 1hr podcast in 1min for ~3-5cents.