4 ms·
I've read the Gemma 3 technical report, it doesn't mention anything about it in the format section. Did they forget to include that? Where did you find the sour
by moffkalast 2y ago
I've read the Gemma 3 technical report, it doesn't mention anything about it in the format section. Did they forget to include that? Where did you find the source that claims otherwise?
- staticman2 2y agoGoogle AI Studio offers no system prompt option for Gemma 3 which also suggests this model doesn't support it...
- moffkalast 2y agoThe official ggufs have this in them as an example, I'm even more confused now: <start_of_turn>user You are a helpful assistant Hello<end_of_turn> <start_of_turn>model Hi there<end_of_turn> <start_of_turn>user How are you?<end_of_turn> <start_of_turn>model
- hnfong 2y agoI was confused by this too, but now I think they’re just suggesting to prepend the system prompt to the first user prompt. I think the ggufs took the chat template defined in tokenizer_config.json , which basically does that.
- hnfong 2y agoMy bad, original comment updated.