3 ms·
Also Ollama is traditionally very sloppy with the chat templates they use, which does impact model performances.
by avereveard 2y ago
Also Ollama is traditionally very sloppy with the chat templates they use, which does impact model performances.
- vergessenmir 2y agoI feel this particularly when I use gguf support. How do you get accurate information on the template structure?
- diggan 2y ago> Ollama is traditionally very sloppy with the chat templates they use Not that I don't believe you (I do, and I think I've seen them correct this before too), but you happen to have specific examples when this happened?
- avereveard 2y agohttps://github.com/ollama/ollama/issues/1977 https://github.com/ollama/ollama/issues/1977 More recently deepseek 2 had a space after the assistant turn, causing issues with output quality and language https://www.reddit.com/r/LocalLLaMA/comments/1dko6rp/if_your_deepseek_coder_v2_is_outputting_chinese/ https://www.reddit.com/r/LocalLLaMA/comments/1dko6rp/if_your...