4 ms·
Which quantized version?
by rytill 3y ago
Which quantized version?
- lukeinator42 3y agothe llama-2-13b-chat.ggmlv3.q4_0.bin version from here: https://huggingface.co/TheBloke/Llama-2-13B-chat-GGML https://huggingface.co/TheBloke/Llama-2-13B-chat-GGML