4 ms·
In case you’re not sure what S1 is, here is the original paper: https://arxiv.org/html/2501.19393v1 https://arxiv.org/html/2501.19393v1
by bberenberg 2y ago
In case you’re not sure what S1 is, here is the original paper: https://arxiv.org/html/2501.19393v1 https://arxiv.org/html/2501.19393v1
- mi_lk 2y agoit's also the first link in the article's first sentence
- bberenberg 2y agoGood call, I must have missed it. I read the whole blog then went searching for what S1 was.
- deleted 2y ago[deleted]
- addandsubtract 2y agoIt's linked in the blog post, too. In the first sentence, actually, but for some reason the author never bothered to attach the name to it. As if keeping track of o1, 4o, r1, r2d2, wasn't exhausting enough already.
- kgwgk 2y ago> for some reason the author never bothered to attach the name to it Respect for his readers’ intelligence, maybe.
- rahimnathwani 2y agoTo enforce a minimum, we suppress the generation of the end-of-thinking token delimiter and optionally append the string “Wait” to the model’s current reasoning trace to encourage the model to reflect on its current generation. Does this mean that the end-of-thinking delimiter is a single token? Presumably </think> or similar wasn't a single token for the base model. Did they just pick a pair of uncommon single-token symbols to use as delimiters? EDIT: Never mind, end of thinking is represented with <|im_start|> followed by the word 'answer', so the code dynamically adds/removes <|im_start|> from the list of stop tokens.
- dagurp 2y agoI don't know what R1 is either
- latexr 2y agoIt’s the DeepSeek reasoning model.