> I still don't understand the purported difference between "sounds smart" and "is smart". To me the difference comes down to the answer to the question: is th

> I still don't understand the purported difference between "sounds smart" and "is smart". To me the difference comes down to the answer to the question: is the output useful or not? Let's say I ask AI questions I already know the answer to. I'll use an example from this thread: Are camels good at cybersecurity? If the AI answers no, I already knew that. I get no new useful information about camels out of this interaction. If the AI answers yes, I know it's wrong. But again, there's no new useful about camels there for me. (yes I now know the AI stinks but that's not my point, my point is I'm asking about camels) So asking AI questions you already know the answer to is pointless. The usefulness (and the goal) of AI is to ask it questions you don't know the answers to, to uncover new truths and insights. If I don't know the answer to a question, how am I supposed to trust that the AI got the answer right? Especially when AI is demonstrating over and over again that it gets the answers wrong. It's clear that AI can't reason, and its results are unreliable to anyone who doesn't know the answer already. So from a practical standpoint, these AIs can't tell you anything you don't already know. It can't be relied upon to teach/tell us new things. So it's an unreliable source of information and should not be relied upon to determine truths. Interestingly formatted, low quality information. All noise little signal. This to me is the difference between "sounds smart" and "is smart". It's about whether or not you can trusting the quality of the output to be accurate and correct. I've met plenty of humans that "sound smart". We call these people bullshitters. AI is at the well spoken BS stage. At best it can smooth talk uninformed people into believing falsehoods. In the age of misinformation, that makes it dangerous in my opinion. God help us if one of them ends up running for office, as it will out-BS all human politicians. It's Artificial Intelligence after all. If the AI output is unreliable, then the AI isn't intelligent.