3 ms·
> Sure, but why does that make the model more effective? If you look something up (on the internet, in a book, asking people directly) and receive two answers,
by Bjartr 3y ago
> Sure, but why does that make the model more effective?
If you look something up (on the internet, in a book, asking people directly) and receive two answers, one which describes the steps used to arrive at the answer, and one which doesn't, on average which one is more likely to be the correct answer?
As a prediction machine, an LLM is more constrained by what is likely to appear after a chain of reasoning.
- naasking 3y agoYou're just repeating the previous explanation with different words, so that's not really satisfactory. A mechanistic demonstration of how step by step reasoning tends to constrain the space of solutions to ones that are more likely to be correct would be an actual explanation, until then this is a just-so story.