3 ms·
And the answer is: LLMs don't know ANY answers. They just know what answers tend to sound like. So it's a fundamental problem.
by foobarbecue 3y ago
And the answer is: LLMs don't know ANY answers. They just know what answers tend to sound like. So it's a fundamental problem.
- SirMaster 3y agoWell I keep seeing people suggest that humans are also really just sophisticated LLMs. If that’s true then this behavior difference (identifying and admitting when you don’t know something) seems like a pretty fundamental difference between humans and LLMs at least at this point.
- iainmerrick 3y agoMany people are bad at this too. It's an important and useful skill to learn, e.g. admitting in team meetings that you don't understand something. I wonder -- does that kind of interaction come up in spoken conversation more than in written text? Things like blog posts and tweets are often stated very confidently. If LLMs are trained mostly from those sorts of sources, maybe that's why they end up artificially overconfident.
- famouswaffles 3y agoDecidedly not true. https://news.ycombinator.com/item?id=37775805 https://news.ycombinator.com/item?id=37775805
- not_enoch_wise 3y agoThoroughly supported by arxiv links. Finally, a paper publishing site unburdened by peer review!