3 ms·
Every model on hugging face defines the input context. For mistral it is "<s>[INST] ... [/INST]" It's pretty obvious if you're writing prompts you have to use
by wokwokwok 3y ago
Every model on hugging face defines the input context. For mistral it is "<s>[INST] ... [/INST]"
It's pretty obvious if you're writing prompts you have to use the correct prompt syntax.
? ollama seems unrelated to the problems I'm having.
There's no way you can define an arbitrary mapping between prompt formats where some have eg. SYSTEM and some don't. It's simply not possible. You have to update your prompts for different models.
I keep a separate list of prompts for each model. It's no big deal.
- v3ss0n 3y agoOllama have prompts properly defined for you in the library.but back to OP that is the problem I am facing too even with ollama.