3 ms·
LLM or transformers just merely extracting signals from human text and build a "contextualized" predictor over a long sequence of words sorted by the informatio
by stevefan1999 6mo ago
LLM or transformers just merely extracting signals from human text and build a "contextualized" predictor over a long sequence of words sorted by the information (technically it is attention) of each token, then generate sentences that way, one by one into other sequences at a time.
But the biggest problem is, even human itself is subjectable to hallucination. That is called being delusional, or being drugged. So it is inevitable from the first principle.
- prewett 6mo agoHumans hallucinate, in the LLM sense, all the time. Did that sign really say that? Nope, I just extrapolated from the first three letters. In the Cambrian Explosion article on HN this morning, I thought the first line said that the earth was desolate. The second line didn't match up with that idea, so I read it again, and the first line said the opposite of what I thought. I particularly hallucinate things into emails from people at work that I disagree with, so much so that I've learned to wait until the next day to reply, and usually I find that they didn't say what I thought they said.
- capten 6mo agoI don't think the paper is saying hallucination is limited to LLM's. The decoupling that needs to happen is the subconscious notion that LLM's are computers. Computers are predictable and calculated (still based on a person's design), but LLM's are unreliable and unpredictable. If the general populous assumes LLM's are as trusted as a calculator, we're in for a bad time. I hope there's a better way to prove that beyond unrealistic stress testing while speaking in absolutes, but honesty needs to come first on all sides.