3 ms·
Instead of setting up a machine for inference, try modal labs (no affiliation): https://modal.com/docs/guide/whisper-transcriber https://modal.com/docs/guide/wh
by IanCal 4y ago
Instead of setting up a machine for inference, try modal labs (no affiliation): https://modal.com/docs/guide/whisper-transcriber https://modal.com/docs/guide/whisper-transcriber
Pay per second GPU processing, with an example of running whisper over 10 GPUs in parallel.
- qwertox 4y agoInteresting. I thought that with these offerings I had to rent a VM with GPU and pay the hourly rate for as long as a VM is running. So this is really 0 USD when not in use? I'm also intending to use this for transcribing my phone answering machine recordings, so the transcription requests come in at random times which means that the transcription service should be constantly available.
- IanCal 4y agoMost are, modal is a very different offering where it's $0 when not in use. They have some other very interesting ideas like charging you for CPU time rather than wall time. It's a newer business so I guess you should factor that risk in though.