But if you ask a human to draw / illustrate a physical setting, they would never draw something that is physically impossible, because it's obvious to a human.

But if you ask a human to draw / illustrate a physical setting, they would never draw something that is physically impossible, because it's obvious to a human. Of course we make all kinds of little mistakes, but at least we can see that they are mistakes. An LLM can't see it's own mistakes, it needs to be corrected by a human. > Physics is just one domain that they work in and Im pretty sure some of them already do have varying understandings of physics. Yeah but that would then not be al LLM or machine learned thing. We would program it so that it understands the rules of physics, and then it can interpret things based on those rules. But that is a totally different kind of AI, or rather a true AI instead of a next-word predictor that looks like an AI. But the development of such AIs goes a lot slower because you can't just keep training it, you actually have to program it. But LLMs can actually help program it ;). Although LLMs are mostly good at currently existing technologies and not necessarily new ones.