2 ms·
LLMs being confidently incorrect until they are challenged is a bad trait. At least they have a system prompt to tell them to be polite about it. Most people l
by phatfish 2y ago
LLMs being confidently incorrect until they are challenged is a bad trait. At least they have a system prompt to tell them to be polite about it.
Most people learn to avoid that person that is wrong/has bad judgment and is arrogant about it.
- ifwinterco 2y agoI think current LLMs suffer from something similar to the Dunning-Kruger effect when it comes to reasoning - in order to judge correctly that you don't understand something, you first need to understand it at least a bit. Not only do LLMs not know some things, they don't know that they don't know because of a lack of true reasoning ability, so they inevitably end up like Peter Zeihan, confidently spouting nonsense