4 ms·

can you please elaborate on the wait tokens? what's that? how do they work? is that also from the R1 paper?

• jebarker 2y ago
  The same idea is in both the R1 and S1 papers (<think> tokens are used similarly). Basically they're using special tokens to mark in the prompt where the LLM should think more/revise the previous response. This can be repeated many times until some stop criteria occurs. S1 manually inserts these with heuristics, R1 learns the placement through RL I think.
  • whimsicalism 2y ago
    ? theyre not special tokens really
    • jebarker 2y ago
      i'm not actually sure whether they're special tokens in the sense of being in the vocabulary
      • whimsicalism 2y ago
        <think> might be i think "wait" is tokenized like any other in the pretraining
• throwaway314155 2y ago
  There's a decent explanation in the article, just FYI.