2 ms·
llama.cpp needs the files to be in ggml format, there is a command string you can run to convert one from the other (as well as perform quantization). Or just d
by pdntspa 3y ago
llama.cpp needs the files to be in ggml format, there is a command string you can run to convert one from the other (as well as perform quantization). Or just download the GGML version
https://www.reddit.com/r/LocalLLaMA/wiki/models#wiki_llama_2_models https://www.reddit.com/r/LocalLLaMA/wiki/models#wiki_llama_2...