3 ms·
and the EOS is "<turn|>". "<|channel>thought\n" is also used for the thinking trace! Can someone explain this to me? Why is this faux-XML important here?
by trashcan2137 6mo ago
and the EOS is "<turn|>". "<|channel>thought\n" is also used for the thinking trace!
Can someone explain this to me? Why is this faux-XML important here?
- pertymcpert 6mo agoThat’s how the model is trained to signal the end to its generation and to indicate its thinking.
- sroussey 6mo agoThese are likely individual tokens. They are super common.