4 ms·
I used the prompt included in llama.cpp and it worked for me in English (for fun GK type questions): MODEL=./models/mistral-7b-v0.1.Q5_K_M.gguf N_THREAD=16 ./e
by daakus 3y ago
I used the prompt included in llama.cpp and it worked for me in English (for fun GK type questions):
MODEL=./models/mistral-7b-v0.1.Q5_K_M.gguf N_THREAD=16 ./examples/chat-13B.sh