2 ms·
Yet another article that imagines we know of some secret sauce in the human brain that DNNs can't possibly have. One for the dustbin. > Unfortunately, this pro
by IshKebab 3y ago
Yet another article that imagines we know of some secret sauce in the human brain that DNNs can't possibly have. One for the dustbin.
> Unfortunately, this promotes a misunderstanding of how large language models (LLMs) work... It might be better to say that everything GPT does is a hallucination, since a state of non-hallucination, of checking the validity of something against some external perception, is absent from these models.
Let me turn it around:
> Unfortunately, this promotes a misunderstanding of how brains work... It might be better to say that every question a human answers without research is a hallucination, since a state of non-hallucination, of checking the validity of something against some external perception, is absent when simply answering a question.
Obviously nonsense. If you're going to write an article about misconceptions you'd better make sure you are right!
(Though it is silly to celebrate hallucinations; they're definitely not desirable.)