3 ms·
do you know if llama.cpp will work out of the box or do we need to wait for the code to be updated?
by itake 3y ago
do you know if llama.cpp will work out of the box or do we need to wait for the code to be updated?
- azeirah 3y agohttps://github.com/ggerganov/llama.cpp/issues/2262 https://github.com/ggerganov/llama.cpp/issues/2262 Likely needs to be updated Edit: Only the case for the 34B and 70B models. 7B and 13B run as-is. You can download the GGML model already https://huggingface.co/TheBloke/Llama-2-7B-GGML https://huggingface.co/TheBloke/Llama-2-7B-GGML https://huggingface.co/TheBloke/Llama-2-13B-GGML https://huggingface.co/TheBloke/Llama-2-13B-GGML