3 ms·
I was confused by this too, but now I think they’re just suggesting to prepend the system prompt to the first user prompt. I think the ggufs took the chat temp
by hnfong 2y ago
I was confused by this too, but now I think they’re just suggesting to prepend the system prompt to the first user prompt.
I think the ggufs took the chat template defined in tokenizer_config.json , which basically does that.