9 ms·
Birds fly, sun shines, and TheBloke always delivers. Though I can't figure out that prompt and with LLama2's template it's... weird. Responds half in Korean an
by moffkalast 3y ago
Birds fly, sun shines, and TheBloke always delivers.
Though I can't figure out that prompt and with LLama2's template it's... weird. Responds half in Korean and does unnecessary numbering of paragraphs.
Just one big sigh towards those supposed efforts on prompt template standardization. Every single model just has to do something unique that breaks all compatibility but has never resulted in any performance gain.
- daakus 3y agoI used the prompt included in llama.cpp and it worked for me in English (for fun GK type questions): MODEL=./models/mistral-7b-v0.1.Q5_K_M.gguf N_THREAD=16 ./examples/chat-13B.sh