3 ms·
Ilya is wrong, hallucinations is not a bug, it’s a feature and it can’t be fixed with RLHF.
by startupsfail 3y ago
Ilya is wrong, hallucinations is not a bug, it’s a feature and it can’t be fixed with RLHF.
- chrisjj 3y agoIndeed, and even his primary example shows that. He says "hallucination in large language models can be attributed to a lack of ground truth from external sources" and quotes the ground truth that disproves the fabricated poem he cites.