3 ms·
It has a specific technical connotation but it does map exactly to what you think it is.[1] Basically it's a trick that recognizes that language transformers o
by seanhunter 3y ago
It has a specific technical connotation but it does map exactly to what you think it is.[1]
Basically it's a trick that recognizes that language transformers only perform computation to generate words so for complex tasks you can get better results by asking the model to explain its chain of thought and only give the answer at the end. This has the effect of giving the model "time to think". If it didn't generate those words it wouldn't have anything to hang that computation off since it is fundamentally a word-generation model.
[1] https://arxiv.org/abs/2201.11903 https://arxiv.org/abs/2201.11903