I was hoping this would be a way to train an LLM that somehow knew when to seek out external knowledge and when not to. I guess this is a pretty unsolvable pro

I was hoping this would be a way to train an LLM that somehow knew when to seek out external knowledge and when not to. I guess this is a pretty unsolvable problem with current architectures. There's just no concrete "confidence" value. I mean, an LLM will give you a probable value for what confidence could be given the words preceding it, but that's an entirely different thing