3 ms·
Even humans are bad at explaining their decisions sometimes, especially if they did not reach there by reason. In fact, if asked for the reason post mortem, pe
by hun3 2y ago
Even humans are bad at explaining their decisions sometimes, especially if they did not reach there by reason.
In fact, if asked for the reason post mortem, people (and LLM) are likely to make them up on the spot. I wonder if the same dynamics is at play here.
- threeseed 2y agoLLMs will provide an answer for every question even when told it doesn't know what it is talking about. Overwhelming majority of people won't do this. So I don't think the comparison really makes any sense.
- adastra22 2y agoHave you used them recently? They have gotten much better about this.
- scratcheee 2y agoI’ve met humans who do that too
- jonathanyc 2y agoYea that’s a good point! On the one hand, it’s cool to look at the JavaScript the LLM generates to test its hypotheses in the logs (you can click “expand” to see them). On the other hand you’re right that especially given that it’s (presumably) an autoregressive LLM, if it writes the choice before the pattern there’s no way for the pattern to influence the choice. You can muck with the prompts by clicking “Settings”! I think there’s a lot of room for improvement with all aspects of the experiment. One prompt I tried made the LLM take tons of turns, but it ended up with a weird fixation with assuming everything was some sort of approximately geometric sequence and would always conclude none of the options matched. Before I gave it the eval_js tool it still did a pretty good job making choices, but the explanations were worse.
- lelandfe 2y agoUnaccountably correct is not a frequent quality I see in humans