3 ms·
> Are you saying that LLMs can't learn to discriminate between which questions they should answer "I don't know" vs which questions they should try to provide a
by dragonwriter 3y ago
> Are you saying that LLMs can't learn to discriminate between which questions they should answer "I don't know" vs which questions they should try to provide an accurate answer?
No, I am saying that they are specific trained to do that, and that the results seen in practice on common real-world LLMs reflect the bias of the specific training they are given for providing concrete answers.
> Sure, there will be an error rate, but surely you can train an LLM to minimize it?
Giving some answer to a question that cannot be infallibly solved analytically is not necessarily an error. In fact, I would argue that providing useful answers in situations like that is among the motivating use cases for AI.
(Whether or not the answers current LLMs provide in these cases are useful is another question, but you miss 100% of the shots you don’t take.)