3 ms·
> We need to be able to plug holes. Otherwise conversation evolves into a list of guarding caveats after each and every message. Absolutely. So the big questi
by vidarh 3y ago
> We need to be able to plug holes. Otherwise conversation evolves into a list of guarding caveats after each and every message.
Absolutely.
So the big question is to what extent what LLMs do is this, but without (yet) having been sufficiently trained on what is reasonable to fill in unknown gaps with, vs. whether there is a bigger issue.
I'm pretty hopeful that it's down to more training on when "I don't know" should be the most likely output, but I think we really don't know until more work has been done on it...