Yup this is so magical. I've always felt there was something off about requiring setting up what is essentially a pytorch/ml dev environment everytime end users

Yup this is so magical. I've always felt there was something off about requiring setting up what is essentially a pytorch/ml dev environment everytime end users "just" want to run inference. A single binary that does this all w/o the python stack is just incredible! edit: Got it going in 1 min! I grabbed the prebuilt artifacts (windows) - https://github.com/ggerganov/whisper.cpp/actions/runs/3635525218 https://github.com/ggerganov/whisper.cpp/actions/runs/363552... Then downloaded ggml-base.bin (148mb) and put it in models/ggml-base.en.bin - https://huggingface.co/datasets/ggerganov/whisper.cpp/blob/main/ggml-base.bin https://huggingface.co/datasets/ggerganov/whisper.cpp/blob/m... Ran it and everything worked! Amazing. Note that only the large (3GB) whisper-v2 is available at the moment, but haven't seen any errors yet from the older small ones. Wild.