3 ms·
I thought Windows could already run the llamafile executable separately and call whatever sized model blob?
by fbdab103 3y ago
I thought Windows could already run the llamafile executable separately and call whatever sized model blob?
- supposemaybe 3y agoI just had a look at their Github, and true enough: “External weights are particularly useful for Windows users because they enable you to work around Windows' 4GB executable file size limit. For Windows users, here's an example for the Mistral LLM: curl -L -o llamafile.exe https://github.com/Mozilla-Ocho/llamafile/releases/download/0.6/llamafile-0.6 https://github.com/Mozilla-Ocho/llamafile/releases/download/... curl -L -o mistral.gguf https://huggingface.co/TheBloke/Mistral-7B-Instruct-v0.1-GGUF/resolve/main/mistral-7b-instruct-v0.1.Q4_K_M.gguf https://huggingface.co/TheBloke/Mistral-7B-Instruct-v0.1-GGU... ./llamafile.exe -m mistral.gguf -ngl 9999