4 ms·
We know that LLMs hallucinate, but we can also remove them. I’d love to see a future generation of a model that doesn’t hallucinate on key facts that are peer
by gdiamos 2y ago
We know that LLMs hallucinate, but we can also remove them.
I’d love to see a future generation of a model that doesn’t hallucinate on key facts that are peer and expert reviewed.
Like the Wikipedia of LLMs
https://arxiv.org/pdf/2406.17642 https://arxiv.org/pdf/2406.17642
That’s a paper we wrote digging into why LLMs hallucinate and how to fix it. It turns out to be a technical problem with how the LLM is trained.
- randomcatuser 2y agointeresting! is there a way to fine tune the trained experts, say, by adding new ones? would be super cool!