2 ms·
And yet ... all they have to do is answer it properly.
by moralestapia 2y ago
And yet ... all they have to do is answer it properly.
- sfink 2y agoIt did! How many R's do you think are in "strawberry"? I get 3, and it got 3. I'm with the LLM. ...oh, you disagree with its intermediate reasoning? You think it should follow a series of logical steps that are each individually correct, rather than pulling wildly incorrect intermediate steps out of its butt and synthesizing them together in the end into a coherent answer that happens to be correct? But that's what an LLM is! Why complain about an LLM being an (unusually transparent) LLM? I think this example serves as a beautiful illustration of how LLMs work, and are supposed to work—even if the correspondence is inexact between (1) incorrect and irrelevant-to-us intermediate steps and (2) internal matrix multiplications that represent incorrect or invalid logic. The correspondence is inexact and probably mostly figurative, but it's still a great example of how internal nonsense can still lead to externally "correct" answers. ("Nonsense" is underselling the complex and highly sophisticated internal state that leads to "correct" answers a stunningly high percentage of the time; I'm just trying to distinguish it from formal logic or the type of reasoning that we think we do and sometimes actually do. And would do, in this example problem.)
- moralestapia 2y agoThat's why I used the word properly, to imply that the whole answer should make sense.
- qeternity 2y agoTraining on the test set is all you need.