4 ms·
I wonder how much of chain of thought is just addressing the fact that LLMs are trained on human writing (much of which are conversations online), which creates
by Salgat 2y ago
I wonder how much of chain of thought is just addressing the fact that LLMs are trained on human writing (much of which are conversations online), which creates an implicit bias in the model towards mimicking conversations where people are trying to explain their problem enough before they get an answer, even if none of this is required with a sufficiently informed expert (which are more rare to find in the training data compared to average people helping each other out in the countless low-voted discussions on reddit/stackoverflow/etc).