3 ms·
> right down to the typo "you name" rather than "your name", which seems unlikely to happen if it were making it up out of thin air. Why is it unlikely? Why d
by O5vYtytb 3y ago
> right down to the typo "you name" rather than "your name", which seems unlikely to happen if it were making it up out of thin air.
Why is it unlikely? Why does prompting it different ways and getting the same result make it unlikely?
- simonw 3y agoIt's also very unlikely that an LLM would hallucinate a prompt with a spelling mistake in it. LLMs are really good at spelling.
- swores 3y agoThat seems to be a fundamental misunderstanding of what LLM hallucinations are? A hallucination, when it comes to LLMs, just means "the algorithm picking most likely next tokens put together a string of tokens that contains false information". It doesn't mean the LLM is having a novel false idea each time. If the first time it hallucinates it thinks that that misspelling is the best next-token to use, why wouldn't it keep thinking that time and time again (if randomness settings are low)?
- afastow 3y agoBecause for practical purposes they just don't make grammatical or spelling mistakes like that. Obviously they're a black box so it's possible there could be some very rare edge cases where it happens anyway, but it'd be a complete fluke. Changing the prompt even superficially would essentially cause a butterfly effect in the model that would prevent it from going down the exact same path and making the same mistake again.
- cubefox 3y ago"Detective, why is it unlikely the witness is lying when several other witnesses say exactly the same thing? Detective?"
- O5vYtytb 3y agoIt's not other witnesses, it's the same system.