3 ms·
Yeah an LLM is basically doing what you would do with the prompt “I’m going to ask you a question, give your best off the cuff response, pulling details entirel
by adastra22 2y ago
Yeah an LLM is basically doing what you would do with the prompt “I’m going to ask you a question, give your best off the cuff response, pulling details entirely from memory without double-checking anything.”
Then when it gets something wrong we jump on it and say it was hallucinating. As if we wouldn’t make the same mistakes.
- kortilla 2y agoIt’s not like that at all. Hallucinations are complete fabrications because the weights happened to land there. It has nothing to do with how much thought or double checking there is. You can trick an LLM into “double checking” an already valid answer and get it to return nonsense hallucinations instead.
- adastra22 2y agoThat’s how your brain works at the base level too.