The issue is it still answers the question confidently and authoritatively. I don't think any reasoned person has an expectation these LLMs will magically know

The issue is it still answers the question confidently and authoritatively. I don't think any reasoned person has an expectation these LLMs will magically know the answer to any question we ask, which is fine, but when it doesn't have an authoritative answer that should be the answer. Like when Google Search says it can find any results, just tell us that. Besides, if we have to invest time to verify the answers then we could have just done the research and answered the question ourselves to begin with.