Agreed. I wonder what that would look like? Something like: if every best next token has a confidence below some threshold for some length of context then the

Agreed. I wonder what that would look like? Something like: if every best next token has a confidence below some threshold for some length of context then the model can confidently assume ignorance? I would love to read the training corpus required to achieve this without metamodeling. That would likely be a utopian forum community devoid of ego and gaslighting and filled with humble people with a thirst for knowledge who clearly communicate the limits of their current experience.