3 ms·
It sure seems like they are programming things into the LLMs with how it often states "As a LLM I can't do that" sort of responses. So how do we get LLMs to ad
by SirMaster 3y ago
It sure seems like they are programming things into the LLMs with how it often states "As a LLM I can't do that" sort of responses.
So how do we get LLMs to admit when they don't know something rather than confabulate? Seems like that would be a really great improvement to me.
- famouswaffles 3y agoNo that's just a training process that goes, "people like this sort of responses better, try to emulate it" by feeding specific input into the training process. >So how do we get LLMs to admit when they don't know something rather than confabulate? The prompts here demonstrably help https://arxiv.org/abs/2305.14975 https://arxiv.org/abs/2305.14975 But otherwise nobody is certain how to do it. The simplest solution is just making them better. Hallucination is something that happens when knowledge/memory fail. By making them more competent, they hallucinate less. So even if they never care about communicating this, you wouldn't notice.