3 ms·
No that's just a training process that goes, "people like this sort of responses better, try to emulate it" by feeding specific input into the training process.
by famouswaffles 3y ago
No that's just a training process that goes, "people like this sort of responses better, try to emulate it" by feeding specific input into the training process.
>So how do we get LLMs to admit when they don't know something rather than confabulate?
The prompts here demonstrably help
https://arxiv.org/abs/2305.14975 https://arxiv.org/abs/2305.14975
But otherwise nobody is certain how to do it. The simplest solution is just making them better. Hallucination is something that happens when knowledge/memory fail. By making them more competent, they hallucinate less. So even if they never care about communicating this, you wouldn't notice.