3 ms·
How are LLMs bad at induction? I thought they were great at induction. This paper doesn’t go into measurements of it, but helps lay out the nature of reasoning
by dr_dshiv 3y ago
How are LLMs bad at induction? I thought they were great at induction. This paper doesn’t go into measurements of it, but helps lay out the nature of reasoning well.
https://aclanthology.org/2023.findings-acl.67.pdf#page15 https://aclanthology.org/2023.findings-acl.67.pdf#page15
- einpoklum 3y agoThey are great at saying things that sounds like the next line of the conversation. That's a certain kind of induction for sure, but probably not the kind you're after.
- robotresearcher 3y ago'Duck induction', by analogy to 'duck typing'.
- astrange 3y agoThere's some effective ways to make them a lot more "truthful" than that, as you can tell by how good GPT-4 is at it. Simple example: sample it a bunch of times. If it's different each time, it likely made it up.