3 ms·
If I just want to play with this as a toy without any performance considerations, is it possible to run this on a CPU only? Or do I need to faf about with getti
by 0cf8612b2e1e 4y ago
If I just want to play with this as a toy without any performance considerations, is it possible to run this on a CPU only? Or do I need to faf about with getting CUDA and that nonsense running?
- zachlatta 4y agoYes, it runs fine on your computer.
- jerpint 4y agoIt’ll run on CPU in decent time, it’ll also depend on the kind of cpu you have and the model you pick. In my m1, the base model can do 5-10s in about as long. I uploaded it to a hugging face space if you just want to fiddle with it without installing https://huggingface.co/spaces/jerpint/babelfish https://huggingface.co/spaces/jerpint/babelfish
- thundergolfer 4y agoYes, it runs well enough on CPU. https://modal-labs-whisper-pod-transcriber-fastapi-app.modal.run/#/ https://modal-labs-whisper-pod-transcriber-fastapi-app.modal... runs on CPU, and chunks up podcast audio to parallelize over dozens of CPUs.
- GistNoesis 4y agoYou probably want to check this port : https://github.com/ggerganov/whisper.cpp https://github.com/ggerganov/whisper.cpp
- 0cf8612b2e1e 4y agoThat indeed seems perfect.