4 ms·

See my comment in this thread about how ChatGPT thinks that sailfish are mammals. I possibly have never read the classification of sailfish explicitly in a book

See my comment in this thread about how ChatGPT thinks that sailfish are mammals. I possibly have never read the classification of sailfish explicitly in a book or a documentary, but I could have classified it as a fish any time of day. For one it's in the name, and furthermore I can imagine with high probability that baby sailfish do not drink milk from their mothers. I don't know if the knowledge in an LLM is stored like in my neurons - I know nothing about neurobiology. But after having used ChatGPT extensively I can certainly tell that ChatGPT does not mobilize knowledge like humans.

rvcdbn 4y ago
It's definitely missing a "module" that humans have: something like an ability to know & admit when it's not certain about something. The way I think of it is: imagine if you constitutionally unable to ever admit that you didn't know something and you were forced to continue talking about that topic. You too would have no choice in this situation but to start spouting nonsense. Once we add this model of uncertainty, I think this type of problem will go away and it will say something like "I'm not sure but ...".