When a LLM hallucinates, it’s not a failure, it’s working perfectly in its context as a language model. Most criticism of LLMs are really a criticism of the la

When a LLM hallucinates, it’s not a failure, it’s working perfectly in its context as a language model. Most criticism of LLMs are really a criticism of the language modelling training task. The underlying technology can be used in other ways which better match our intuitive understanding of “general intelligence” Unfortunately I think major research labs will be increasingly secretive as they gain traction in training large transformers as general agents.