19 ms·
Exactly, whether or not it’s the “actual thought” of the model, it does influence its final output, so it matters to the user.
by ziofill 1y ago
Exactly, whether or not it’s the “actual thought” of the model, it does influence its final output, so it matters to the user.
- otabdeveloper4 1y ago> it does influence its final output We don't really know that. So far CoT is only used to sell LLMs to the user. (Both figuratively as a neat trick and literally as a way to increase token count.)
- aqfamnzc 1y agoNot even remotely true. It's part of the context window, so it greatly influences the final output. CoT is tokens generated by the LLM just like normal output.