4 ms·
That still won’t make them understand physics. This all reminds me of “fixing” mis-architected software by adding extra conditional code for every special case
by layer8 2y ago
That still won’t make them understand physics.
This all reminds me of “fixing” mis-architected software by adding extra conditional code for every special case that is discovered to work incorrectly, instead of fixing the architecture (because no one understands it).
- tossandthrow 2y agoThis is more a comment to the word "understand" than "physics". Yes, the models output will converge to being congruent with laws of physics by virtue of deriving that as a latent variable.
- deleted 2y ago[deleted]
- falcor84 2y ago>That still won’t make them understand physics I would assume that larger models working with additional training data will eventually allow them to understand physics to the same extent as humans inspecting the world - i.e. to capture what we call Naive Physics [0]. But the limit isn't there; the next generation of GenAI could model the whole scene and then render it with ray tracing (no special casing needed). [0] https://en.wikipedia.org/wiki/Na%C3%AFve_physics https://en.wikipedia.org/wiki/Na%C3%AFve_physics
- layer8 2y agoThere seems to be little basis for this assumption, as current models don’t exhibit understanding. Understanding would allow to apply it to situations that don’t match existing patterns in the training data.
- aj7 2y agoThat’s not large models “understanding physics.” Better, giving output “statistically consistent” with real physical measurements. And no one, to my knowledge, has yet succeeded in a general AI app that reverts to a deterministic calculation in response to a prompt.
- paulmd 2y agochatgpt has had the ability to generate and call out to deterministic python scripts for a year now
- astrange 2y ago> And no one, to my knowledge, has yet succeeded in a general AI app that reverts to a deterministic calculation in response to a prompt. They will all do this with a fixed seed. They just don't do that because nobody wants it.
- energy123 2y agoMaybe it will. It really depends whether it's "easier" for the network to learn an intuitive physics, versus a laundry list of superficial hacks that let it minimise loss all the same. If the list of hacks grows so long that gradient descent finds it easier to learn the actual physics, then it'll learn the physics. Hinton argues that the easiest way to minimise loss in next token prediction is to actually understand meaning. An analogous thing may hold true in vision modelling wrt physics.
- quonn 2y ago> that gradient descent finds it easier to learn the actual physics, then it'll learn the physics. I guess it really depends on what the meaning of gradient decent learning the physics is. Maybe you define it to mean that the actually correct equations appear encoded in the computation of the net. But this would still be tacit knowledge. It would be kind of like a math software being aware of physics at best.
- Frieren 2y ago> It really depends whether it's "easier" for the network to learn an intuitive physics, versus a laundry list of superficial hacks that let it minimise loss all the same. Human innate understanding of physics is a laundry list of superficial hacks. People needs education and mental effort to go beyond that innate but limited understanding.
- godelski 2y agoWhen it is said that humans innately understand physics, no one means that people innately understand the equations and can solve physics problems. I think we all know how laughable such a claim would be, because how much people struggle when learning physics and how few people even get to a moderate level (not even Goldstein, but at least calculus based physics with partial derivatives). What people mean when saying people innately understand physics is that they have a working knowledge of many of the implications. Things like that gravity is uniformly applied from a single direction and that is the direction towards ground. That objects move in arcs or "ballistic trajectories", that straight lines are uncommon, that wires hang with hyperbolic function shapes even if they don't know that word, that snow is created from cold, that the sun creates heat, many lighting effects (which is how we also form many illusions), and so on. Essentially, humans know that things do not fall up. One could argue that this is based on a "laundry list of superficial hacks" and they wouldn't be wrong, but they also wouldn't be right. Even when wrong, the human formulations are (more often than not) causally formulated. That is, explainable _and_ rational (rational does not mean correct, but that it follows some logic. The logic doesn't need to be right. In fact, no logic is, just some are less wrong than others).
- noduerme 2y agoIsn't that just what neural networks do? The way light falls on an object is physically deterministic, but the neural network in the brain of a human painter doesn't actually calculate rays to determine where highlights should be. A center fielder knows where to run to catch a fly ball without having to understand the physics acting on it. Similarly, we can spot things that look wrong, not because we're refering to physical math but because we have endless kludged-together rules that supercede other rules. Like: Heavy objects don't float. Except for boats which do float. Except for boats that are leaking, which don't. To then explain why something is happening we refer to specialized models, and these image generation models are too general for that, but there's no reason they couldn't refer to separate physical models to assist their output in the future.
- bawolff 2y ago> This all reminds me of “fixing” mis-architected software by adding extra conditional code for every special case that is discovered to work incorrectly... Isn't that what AI training is in general? It has worked pretty well so far. I dont think img-gen AI is ever going to "understand physics", but that isn't the task at hand. I don't think it is neccesary to understand physics to make good fake pictures. For that matter, i dont think understanding physics would even be a good approach to the fake picture problem.
- midtake 2y agoMost "humans" don't understand physics to a Platonic level and act in much the same way as a model, finding best fits among a set of parameters that produce a result that fits some correctness check.
- wvenable 2y ago> That still won’t make them understand physics. They don't have to. They just have to understand what makes a realistic picture. The author of the article isn't really employing physics either; he's comparing the eyes to each other.