4 ms·
Asking "why do large language models hallucinate?" is a good question to ask and answer, just like "why do birds sing?" or "why is the sky blue?" are. The probl
by seba_dos1 2y ago
Asking "why do large language models hallucinate?" is a good question to ask and answer, just like "why do birds sing?" or "why is the sky blue?" are. The problematic part is when you're somehow surprised that the sky is blue, birds sing and LLMs do nothing but hallucinate.
- lainga 2y agoTiger gotta hunt, bird gotta fly, LLM gotta answer "why, why, why?" Tiger gotta sleep, bird gotta land, LLM gotta produce a token from the context at hand