5 ms·
Happy to reply. Let's ask LLM to generate some text given a prompt. It replies with a bunch of words. Let's ask LLM to generate some text given a different pr
by 4ndrewl 3y ago
Happy to reply.
Let's ask LLM to generate some text given a prompt. It replies with a bunch of words.
Let's ask LLM to generate some text given a different prompt. It replies with a bunch of other words.
In both instances, the model worked correctly, and as defined. It produced a bunch of words based on context, statistics and some forced randomness.
If we call one of them an hallucination because it does not match how we would expect a human to respond, we have to accept the other is also an hallucination because it was generated in exactly the same way, using exactly the same model.
If you disagree, ask the LLM to 'Compose a single-line avant-garde poem about rainbows, without mentioning rainbows'. Look at the reply. How would you tell whether it's hallucinating or not?
- YetAnotherNick 3y agoWhat should a non hallucinating human reply to 'Compose a single-line avant-garde poem about rainbows, without mentioning rainbows'? Also my objection wasn't that it hallucinates, my objection was to the OP's point that it only hallucinates. If I ask it what is 2*2 and it answers 4 would that be a hallucination or not?
- 4ndrewl 3y agoWhy would that matter?