4 ms·
The llama source code in the original repo has been updated for llama 2: https://github.com/facebookresearch/llama https://github.com/facebookresearch/llama
by ezyang 3y ago
The llama source code in the original repo has been updated for llama 2: https://github.com/facebookresearch/llama https://github.com/facebookresearch/llama
- itake 3y agodo you know if llama.cpp will work out of the box or do we need to wait for the code to be updated?
- azeirah 3y agohttps://github.com/ggerganov/llama.cpp/issues/2262 https://github.com/ggerganov/llama.cpp/issues/2262 Likely needs to be updated Edit: Only the case for the 34B and 70B models. 7B and 13B run as-is. You can download the GGML model already https://huggingface.co/TheBloke/Llama-2-7B-GGML https://huggingface.co/TheBloke/Llama-2-7B-GGML https://huggingface.co/TheBloke/Llama-2-13B-GGML https://huggingface.co/TheBloke/Llama-2-13B-GGML