2 ms·

"It just doesn't care about telling you this." But why? Why would the LLM creators want the LLM giving out knowingly bad information? This is what I don't un

• famouswaffles 3y ago
  LLM creators train the model to predict the next token. They have no control over what it learns in the process. We're not programming anything into artificial neural networks so control or direction is limited.
  • SirMaster 3y ago
    It sure seems like they are programming things into the LLMs with how it often states "As a LLM I can't do that" sort of responses. So how do we get LLMs to admit when they don't know something rather than confabulate? Seems like that would be a really great improvement to me.
    • famouswaffles 3y ago
      No that's just a training process that goes, "people like this sort of responses better, try to emulate it" by feeding specific input into the training process. >So how do we get LLMs to admit when they don't know something rather than confabulate? The prompts here demonstrably help https://arxiv.org/abs/2305.14975 https://arxiv.org/abs/2305.14975 But otherwise nobody is certain how to do it. The simplest solution is just making them better. Hallucination is something that happens when knowledge/memory fail. By making them more competent, they hallucinate less. So even if they never care about communicating this, you wouldn't notice.