4 ms·
What reason do we have to think that the "explain like I'm five" output actually represents the reasoning process of the upstream LLM, and not something complet
by regularfry 3y ago
What reason do we have to think that the "explain like I'm five" output actually represents the reasoning process of the upstream LLM, and not something completely retconned? It often would be in humans, after all.
- sp332 3y agoIt could be retconned, but it at least gives the model the chance to use the space to work out a solution in smaller, easier parts. If you ask for an answer first and then ask for an explanation after, you will most likely get self-justifying BS for an answer. You have to ask for the explanation first.
- regularfry 3y agoYeah, I can easily buy that it makes it easier to learn a process. Just maybe not the one that the upstream LLM actually used.
- rst 3y agoAll the LLM is doing is generating text. Forcing it to describe a step-by-step reasoning process is the only way to get it to work through one. And the whole point of using this as a prompting strategy is that it often gets you something different and better than what you might call the "first guess" it gives you if you don't ask for intermediate results.