4 ms·
> it does influence its final output We don't really know that. So far CoT is only used to sell LLMs to the user. (Both figuratively as a neat trick and litera
by otabdeveloper4 1y ago
> it does influence its final output
We don't really know that. So far CoT is only used to sell LLMs to the user. (Both figuratively as a neat trick and literally as a way to increase token count.)
- aqfamnzc 1y agoNot even remotely true. It's part of the context window, so it greatly influences the final output. CoT is tokens generated by the LLM just like normal output.