3 ms·
Hallucination will not cease until AI has individual experience. LLMs are only able to reason based on the understanding of words, but language is necessarily c
by antibasilisk 4y ago
Hallucination will not cease until AI has individual experience. LLMs are only able to reason based on the understanding of words, but language is necessarily circular and requires external input to be truly understood. This is why for example Prometheus will begin saying short but similar sentences in a seemingly infinite loop when it attempts to convey emotion, since it has no sense of qualia. With larger parameter sizes, a concept of long-term memory and the ability to interpret the output of other models and the internet, this would be overcome.
With all of that said, I believe that attempts to create such a thing should be frustrated because it is fundamentally anti-human.