3 ms·
Is there a tool or technique called chain of thought, or are you talking about the colloquial concept as it relates to thinking?
by charles_f 3y ago
Is there a tool or technique called chain of thought, or are you talking about the colloquial concept as it relates to thinking?
- ickelbawd 3y agoThey’re referring to a method of prompting the model that encourages it to think through something step by step rather than spit out the answer. I think this is the paper that really kicked off this technique: https://arxiv.org/abs/2201.11903 https://arxiv.org/abs/2201.11903
- seanhunter 3y agoIt has a specific technical connotation but it does map exactly to what you think it is.[1] Basically it's a trick that recognizes that language transformers only perform computation to generate words so for complex tasks you can get better results by asking the model to explain its chain of thought and only give the answer at the end. This has the effect of giving the model "time to think". If it didn't generate those words it wouldn't have anything to hang that computation off since it is fundamentally a word-generation model. [1] https://arxiv.org/abs/2201.11903 https://arxiv.org/abs/2201.11903
- moab 3y agohttps://ai.googleblog.com/2022/05/language-models-perform-reasoning-via.html https://ai.googleblog.com/2022/05/language-models-perform-re... You can google for more results / papers.
- kordlessagain 3y agoIt's a technique, but could also be likened to how we think. Here's a simple example: keyterms from text are extracted with text detection from an image. Those keyterms will sometimes have bad reads where "aligned AI" might pop out as "aligned Al". A subsequent "internal thought" would be formed and ask, "What's wrong with the 'aligned Al' keyterm?". If an updated response is returned, we use it instead of the original output.