12 ms·
Roboticists discover alternative physics
- mikewarot 4y ago:::Tangent::: So if you had a new neural network, observing the physical world, and put a simple chaotic physics system within it's field of view, it would learn to encode such systems, and perhaps begin to understand the laws of physics? So that's why we put dangly things above cribs for babies to focus on.
- aaaaaaaaaaab 4y agoUgh... Sorry but this is not physics.
- thriftwy 4y agoWhy not? It will surely have the same bounding box as our own physics, but the laws may be represented in completely different fashion. They would mostly map to each other, though. Or maybe not. Maybe the "AI physics" has predictions for phenomena which our physics never bothered to figure out, whereas it would ignore large chunks of our physics area as irrelevant.
- aaaaaaaaaaab 4y agoThis is more like the empirical "laws" that various engineering disciplines use. I.e. some number crunching that has no theoretical foundations whatsoever, but seems to be working anyway.
- dmos62 4y agoWhat is physics, if not a transition between states? Whether the merchanism that predicts those transitions is machine- or human-interpretable is orthogonal.
- goatlover 4y agoAn attempt to describe fundamental nature of the word, best as we can get at it. Unless you're an antirealist, or you think the universe is just information.
- deleted 4y ago[deleted]
- thriftwy 4y agoEven if universe is still information, knowing laws which govern change of that information is no lesser valuable.
- forgotusername6 4y agoThis reminds me of my tribology course. The professor said at the beginning that there weren't many real equations but here are some lookup tables.
- Daub 4y agoAgreed, if only for the reason that the AI seems to be making observations of the physical world based on videos thereof.
- samloveshummus 4y agoI don't see why that's relevant, a video camera is just another instrument that records data, not essentially different from the detectors at the LHC, albeit completely un-optimized - which is necessary for this experiment to work.
- Daub 4y agoIf all the AI is seeing of the world is a digital image, then they are likely to mistake the digital image for the world. As far as I know, the article claims that the AI has discovered new physical variables, yet the researchers are unsure as to what they are. For all we know, these variables are the distance of objects from the edge of the image frame.
- Shorel 4y agoApart from some very slow atom and particle simulations... Is not most physics based on very extreme oversimplifications? They are still very useful because errors average out, but for example: we don't know why fluid simulations work, in fact aerodynamics is an entire empirical field. This was seen in F1 this year. All cars bouncing on straights, it was even given the name porpoising by the pilots. The teams never expected it, because the simulations never discovered anything about it. Also: all the work of AlphaFold predicting protein structures. Physics are awesome at predicting planetary motion, but stuff at smaller scales require a lot of empirical engineering to figure out.
- JPLeRouzic 4y ago> but stuff at smaller scales require a lot of empirical engineering to figure out. And that made the fortune of CAD software designers.
- mhh__ 4y agoThe porpoising is apparently because the more expensive higher speed wind tunnel analysis is banned. Engineering needs engineering,. Physics does not. The interesting thing about aero in physics is the emergence of extremely complicated phenomena, not the equations as per se.
- samloveshummus 4y agoI'm not sure why you don't think it's Physics. It's about formulating laws that describe the behaviour of physical systems - that's the essence of what Physics is. I have a PhD in high energy theory and this really seems like Physics to me.
- mjburgess 4y agoSure, if the pseudoscientific description of factor analysis applied to images is correct, then it's phyiscs. As-is, it's pseudoscience. What happens when you do a factor analysis on images? You get some measure of the axes of geometrical variance across those images. Are those axes "related" to any physical variables, sure -- but almost never directly. To suppose the system itself had these properties is to suppose, for example, constellations actually exist and cause your personality traits. Everything we want to know is what phyical properties of the system give rise to the observed consistent correlations in geometrical properties. *THAT* is physics. Showing these geometrical properties exist and are consistent is just what we're trying to explain. You cannot go from images to the domain of physics -- there are an infinite number of theories consistent with these images domains. And this is pseudoscience.
- samloveshummus 4y agoIt's really easy to test whether or not it works - see how well the model predicts on out-of-training sample data. That wouldn't work with astrology. There's no such thing as "physical properties of the system" other than measurable quantities that can be used to make predictions, which is what this does. There's no reason to be sure that temperature, for example, is a "real" physical property of a system rather than just one of many variables that would help us model it and understand it. Do you think it's pseudoscientific because there's no theory-ladenness in the predictions?
- mjburgess 4y agoIt's pseudoscience because there's nothing in the geometrical properties of those images called "gravity", etc. One can generate those pixel patterns from an infinite number of theories with an infinite variety of causally efficacious parameters. From the article, it doesn't work. They found on known physics it gives 4.7 dimensions, of which only two are explicable -- 4 is correct; the others have no known physical interpretation. No surprises: those two are just the geometric properties of the system (angles) which are actually properties of the image. The others are pure bullshit. Since, of course, the real physical parameters of the system we take to have generated those images are not present in them. The images are distal effects of these things Only in cases where the geometric properties of the target system are causally relevant to its actual causal properties will this work -- ie., only when "angles matter" Thinking you can infer laws of nature from images is pseudoscience, and these guys need to think more carefully about why we experiment in the first place eg., Consider that if mass is a relevant causal property, there'd be no way of inferring it from images: two objects can be visually identical whilst having radically different masses... making images *OBVIOUSLY* not a measure of mass... this project almost defines the modern kind of schizophrenic pseudoscience born of this wave of AI
- ndsipa_pomu 4y agoI'm not seeing the significance of that. Surely there's plenty of alternate descriptions of physics/systems that can be equally predictive and certainly there's lots of equivalences to shift from one framework to another.
- samloveshummus 4y agoIt's true that there are many mathematically equivalent ways to describe physical systems. But the important point is that some are more useful than others. For example, Lagrangian mechanics and Hamiltonian mechanics are equivalent to Newtonian mechanics, but they can give much better intuition for certain problems. Feynman diagrams are equivalent to grinding out the QFT algebra by hand à la Schwinger, but they give a completely different intuition for the underlying Physics. More importantly, though, they could use this NN on systems that have not yet successfully been modeled, perhaps complex dynamical systems, to discover good parameters and conserved quantities.
- MauranKilom 4y ago> More importantly, though, they could use this NN on systems that have not yet successfully been modeled, perhaps complex dynamical systems, to discover good parameters and conserved quantities. That would only make sense to try if the model could do this for systems we already understand. By the sound of the article, it can't even do that. Despite many efforts the researchers couldn't even understand the second pair of parameters. That doesn't correspond to my understanding of "good parameters".
- sbf501 4y ago> For example, Lagrangian mechanics and Hamiltonian mechanics are equivalent to Newtonian mechanics, but they can give much better intuition for certain problems. Feynman diagrams are equivalent to grinding out the QFT algebra by hand à la Schwinger, but they give a completely different intuition for the underlying Physics. I just read about Langrangian and Hamiltonian mechanics. I didn't encounter those at all in my EE physics, and they are fascinating. Great examples! Are you a physics professor, or is this stuff undergrad physics majors learn?
- jack_riminton 4y agoAren't they just placeholders that help to predict a physical outcome rather than objective measurements?
- radarsat1 4y agoThis reminded me a great deal of a paper I read like 10 years ago, which I just looked up because I wanted to see if it was cited here, "Distilling Free-Form Natural Laws from Experimental Data" [0]. Lo and behold it is not only cited, but is written by the same authors. So the novelty here, as discussed in the paper [1], is that they are doing something similar but from video instead of from sensor streams. Which is quite interesting, as it opens up the available information to systems that are hard to 'sense' apart from pointing a camera at them, like the lava lamp example. I did see a presentation a few years ago on a similar topic by Erwin Couwans, author of Bullet physics engine, who was discussing doing neural inference of physics. He basically wanted to replace Bullet with a neural network, which I thought was kind of funny at the time, but cool if it worked. (Physical laws at this level of mechanics are mostly quite well understood, but the devil is in the details and actually solving time-discretized non-smooth dynamics, as well as performing good contact detection is less than obvious the more you get into it, not to mention friction, so I could see why a "learned" solution could be attractive, but at the time I found it funny that he was proposing to learn the physics that were already simulated by Bullet.) Looking back, it appears that those ideas culminated in a paper [2] two years ago, which I'll have to read now -- from the abstract, the differentiability of the simulation has benefits not only for learning the physics (mostly friction models it appears), but for learning controllers for plants within the simulated physics. It seems to be not cited in the linked article but maybe it is a slightly different, but related, topic. In any case, fascinating stuff. [0]: https://www.science.org/doi/10.1126/science.1165893 https://www.science.org/doi/10.1126/science.1165893 [1]: https://arxiv.org/abs/2112.10755 https://arxiv.org/abs/2112.10755 [2]: https://arxiv.org/abs/2011.04217 https://arxiv.org/abs/2011.04217
- ok_dad 4y agoThat’s interesting thanks for sharing. I always was bearish on neural networks when advertised as “AI”, but now I think that perhaps when used as a tool rather than a panacea they could be very useful. Humans learn to operate heavy machinery in industrial settings through experience and use via our own neural networks, and we have incomplete understanding of physics, so why not use a neural network to learn the physically best way to drive an industrial machine and use the physics as backup for safety? Seems to work well based on all these stories so far, so maybe learning neural networks are the next differential equations for engineering.
- deleted 4y ago[deleted]
- deleted 4y ago[deleted]
- YeGoblynQueenne 4y agoSo these guys trained "an AI" to identify hidden variables by looking at videos of physical phenomena, without prior knowledge of physics (except what was implicitly and obscurely encoded in "the AI's" neural net architecture, and its training set and hyperparameters, by the researchers). The "AI" came up with a slightly off number and the researchers struggle to understand why. They struggle because "the AI" is a black box that lacks explainability and cannot produce an explanatory model, only a predictive model [1]. The simplest conclusion is that their "AI" has not learned any useful models, and has only learned to accurately predict their test set, to which the authors had acces throughout the training of "the AI" [2]. The simplest explanation is that their model isn't very good at doing what they wanted it to do, but they opt to explain it as a scientific mystery, instead. Why? It seems the only reason to try and see a scientific mystery where a simple failure would suffice as an explanation is because the model is "an AI". There seems to be some kind of expectation that "an AI" must have some deeper understanding of physics than humans, even when we don't understand what it's doing, even whe it's not doing very well. In short, this seems to be based on very wrong assumptions and to be coming up with very wrong conclusions, but then again it makes for a great headline and so here we are, discussing it on HN. ____________________ [1] To clarify: a predictive model is one that can predict novel events. An explainable model is one that can explain how it made a prediction. An explanatory model is one that explains how the world works and why certain predictions are true, or not. Predictive and explainable models are useful, but most scientists aim to build explanatory models, because an explanatory model is necessarily also explainable and ultimately better at predictions, while a predictive model is not necessarily explainable or explanatory and an explainable model is not necessarily predictive or explanatory. Deep neural nets can only build predictive models, which are sometimes explainable, but they can't build explanatory models. That's because they can only identify correlations in data, but not explain those correlations with generalised theories, based on previous knowledge. To put it plainly, neural nets can't come up with scientific theories, but they can estimate probabilities of things happening. But scientists can and want to come up with scientific theories, not just predictions. [2] When the experimenter has access to the test data and can tune the learner's model until it scores highly on the test data, that leads to a model that overfits to the test data. Such a model is useless for prediction over unseen data (i.e. data not available to the researchers during training).
- taneq 4y ago> OK so we know the answer to this question is 4, let's check our new software against that. > [software returns 4.7] > Oh my GOD, it's discovered new physics!
- toxicFork 4y agoAt least it wasn't 42
- Rerarom 4y agoThe new physics is not in the 4.7 but that in that the model's third and fourth variables seem to be new, compared to the known models.
- YeGoblynQueenne 4y agoThey seem to be uncorrelated with real-world physics. Whether they are "new" is anybody's guess. They're variables identified in a virtual environment, rather than the real world so there's very little chance they correspond to something in the real world, let alone physics, much less "new physics".
- a9h74j 4y agoI saw it commented somewhere that epicycles (of astronomical fame) are essentially additional terms in a Fourier series. I suppose anything nonlinear could invite multiple terms incidental to a particular local fit.
- coliveira 4y agoGood summary. There's no end to the kind of delusion some AI proponents will cling too. In a few days they'll say this is another proof we live in a simulation!
- JackFr 4y agoBut can they play the tape backwards and come up with entropy.
- danwills 4y agoWhat am interesting idea!
- jug 4y agoI've thought about this myself before so this was an interesting read! I've thought in particular about quantum theories and how they are so hard to reconcile with gravity, and the hierarchy problem. Maybe we do simply struggle because this reality is so distant from the one we experience that we have trouble understanding it. Or maybe it is because we formalized it empirically but we got off on the wrong foot unlike Einstein's part that seems to come together better. Max Planck built his framework, not because he understood why quantum physics is the way it is, but because he observed how it worked. Since it works, we build upon that, what else can we do... So it looks like it's right to build on but we're having the damndest time to move forward. This can be very hard to later backtrack on!
- alzyx 4y agosince it's paywalled and genlib doesnt seem to already have it, here's the ArXiv link: https://arxiv.org/pdf/2112.10755.pdf https://arxiv.org/pdf/2112.10755.pdf
- CrimpCity 4y agoThis is cool and I personally believe this type of work may lead to breakthroughs in messy data rich fields like biology where we can arrive at a higher levels of abstraction maybe not exactly to "laws" like physics but highly correlative rules around phenomena. I think this is more on the side of knowledge creation and is human friendly as opposed to being more of a black box prediction like deep neural networks. Though I think both things are complimentary since human curiosity isn't satisfied by prediction alone. If anyone else is interested in this line of work I recommend checking out Kathleen Champion, Steve Brunton, and J. Nathan Kutz's work on Discovering governing equations from data by sparse identification of nonlinear dynamical systems(https://www.pnas.org/doi/full/10.1073/pnas.1517384113 https://www.pnas.org/doi/full/10.1073/pnas.1517384113). Also this intro video is great! https://youtu.be/Z-l7G8zq8I0 https://youtu.be/Z-l7G8zq8I0
- deleted 4y ago[deleted]
- jamesakirk 4y agoThank you for mentioning J. Nathan Kutz! Reading through this article, I saw similarities to Dynamic Mode Decomposition (I am not literate enough on the topic to elaborate). His Coursera courses and book were a fascinating dive into orthogonal basis functions, lower-rank approximations like PCA... I'm not sharp enough anymore (over a decade since grad school) to fully grok it, but damn his work is so cool!
- rch 4y agoFrom the paper: > code to reproduce our training and evaluation results is available at the Zenodo repository and GitHub (https://github.com/BoyuanChen/neural-state-variables https://github.com/BoyuanChen/neural-state-variables).
- jovial_cavalier 4y agoState variables of dynamic systems can be arbitrary. The fact that two that were selected by an automatic process happened to correspond to the two angles is probably more interesting than the other two being uncorrelated with the momenta.
- mike_hock 4y agoI guess it's because it's a serendipitous discovery by roboticists rather than an experiment explicitly set up to discover "alternative physics," but wouldn't it be much more efficient to feed the NN actual physical measurements rather than a video if discovering physical models was the goal? It's amazing that the AI found two variables that corresponded to actual physical phenomena just from video footage but it seems highly unlikely that it found an alternative description of physics given how far off the answer was. The NN could be modeling any kind of weird "fantasy" for how the visual signal it was being fed could be produced that might not even correspond to 3D space in a meaningful way.
- jovial_cavalier 4y agoThere should be four state variables for a double pendulum system - angle 1, angle 2, momentum 1, momentum 2. But they don't have to be neatly divided up like that. Angle 1 could be represented by some proportion of all four quantities. The individual variables can have no physical significance in of themselves whatsoever as long as there is a mechanism for turning them into the final answer.
- daveguy 4y agoIt's interesting that the angular explanatory variables are also those that are easily measured in a 2d still image. Whereas the angular velocity requires differential information and is not be immediately represented in each individual image.
- hsnewman 4y agoI posted this 4 days ago.
- lisper 4y agoWorth noting: the concept of "energy" was controversial for a very long time. https://en.wikipedia.org/wiki/Conservation_of_energy#History https://en.wikipedia.org/wiki/Conservation_of_energy#History
- comboy 4y agoWell, it does seem like a "made up", not directly measurable variable. We just have it for convenience of understanding the world. Or am I missing something?
- _hcuq 4y agoMy current thinking (I’m a total dilettante….) is that energy is a state in closed system. The system of course designed by the observer. For example, a cart half way up a hill. Does it have positive or negative potential energy? Depends on how you define your system.
- lisper 4y agoNothing is "directly measurable". Everything in science is a story that we make up to explain our personal experience, including "measurement" and "observation".
- alok-g 4y agoAccording to Noether's theorem, law of conservation of energy is same as symmetry of laws (equations) of physics with respect to time.
- a_nop 4y agoI'll be tickled when they discover the AI is measuring the lens distortion of the camera or some other artifact of the signal chain.
- a-dub 4y agomore cameras. more physical systems. different settings. more data. :)
- Tao3300 4y agoI was also wondering if one or more of these variables pertain to perception. Digital artifacts in the video being mistaken for machine elves.
- bufferoverflow 4y agoOr the noise specific to that camera sensor.
- twobitshifter 4y agoSeems likely that it would, our eyes have to do the same thing dealing with saccades, blind spots, inversions, distortion and more.
- lowbloodsugar 4y agoHaving been programming a while, when confronted with "Well, it got the answer 4.7, and we figured out 2, and we can't figure what the other 2.7 are", I wouldn't leap to "Wow, the AI has found a whole new physics". I'd go with "bug", until I can very concretely describe otherwise.
- a-dub 4y ago> A particularly interesting question was whether the set of variable was unique for every system, or whether a different set was produced each time the program was restarted. indeed! i'm assuming it finds the same variables over multiple runs with different rng seeds. if that is true, it seems the next interesting question is if multiple kinematic problems can be used for the training of the same net. one key feature of physics is that it was invented to describe general principles that apply to multiple problems, so it doesn't surprise me that it might find some more optimal representation that doesn't necessarily generalize to other physical problems.
- ijidak 4y ago> the AI produced the answer: 4.7 This gave me a Hitchhikers Guide chuckle.
- solarmist 4y agoThis is an extremely insightful comment. LOL It does make sense though. Answers a much easier to arrive at than questions or processes.
- 7speter 4y agoSo uhh, is this how skynet figured out time travel?