4 ms·
LLM creators train the model to predict the next token. They have no control over what it learns in the process. We're not programming anything into artificial
by famouswaffles 3y ago
LLM creators train the model to predict the next token. They have no control over what it learns in the process. We're not programming anything into artificial neural networks so control or direction is limited.
- SirMaster 3y agoIt sure seems like they are programming things into the LLMs with how it often states "As a LLM I can't do that" sort of responses. So how do we get LLMs to admit when they don't know something rather than confabulate? Seems like that would be a really great improvement to me.
- famouswaffles 3y agoNo that's just a training process that goes, "people like this sort of responses better, try to emulate it" by feeding specific input into the training process. >So how do we get LLMs to admit when they don't know something rather than confabulate? The prompts here demonstrably help https://arxiv.org/abs/2305.14975 https://arxiv.org/abs/2305.14975 But otherwise nobody is certain how to do it. The simplest solution is just making them better. Hallucination is something that happens when knowledge/memory fail. By making them more competent, they hallucinate less. So even if they never care about communicating this, you wouldn't notice.