> your question is pretty confusing That's exactly the point, isn't it? If the AI had some model of reality, it would probably be confused by the question. But

> your question is pretty confusing That's exactly the point, isn't it? If the AI had some model of reality, it would probably be confused by the question. But it doesn't express confusion, it confidently answers the question in a way that doesn't make sense. It acts like everything it is reading and saying is completely coherent because it doesn't have the ability to distinguish coherent ideas from nonsense.