8 ms·
DeepMind AI learns simple physics like a baby
- mdp2021 4y agoAnother divulgative article: -- DeepMind AI learns physics by watching videos that don't make sense - An algorithm created by AI firm DeepMind can distinguish between videos in which objects obey the laws of physics and ones where they don't - https://www.newscientist.com/article/2327766-deepmind-ai-learns-physics-by-watching-videos-that-dont-make-sense/ https://www.newscientist.com/article/2327766-deepmind-ai-lea... > Luis Piloto at DeepMind and his colleagues have created an AI called Physics Learning through Auto-encoding and Tracking Objects (PLATO) that is designed to understand that the physical world is composed of objects that follow basic physical laws. // The researchers trained PLATO to identify objects and their interactions by using simulated videos of objects moving as we would expect [...] They also gave PLATO data showing exactly which pixels in every frame belonged to each object. To test PLATO’s ability to understand five physical concepts such as persistence..., solidity and unchangingness..., the researchers used another series of simulated videos. Some showed objects obeying the laws of physics, while others depicted nonsensical actions [with the latter, correctly the AI returned wrong predictions, showing an acquired intuition of physics] From the submitted one: > [Jeff Clune, Uni British Columbia, Vancouver: ]«[Comparing AI with how human infants learn is] an important research direction. That said, the paper does hand-design much of the prior knowledge that gives these AI models their advantage». // Clune and other researchers are working on approaches in which the program develops its own algorithms for understanding the physical world
- danielmorozoff 4y agoSimilar work has been pursued for a number of years now in a Darpa program called Machine Common Sense: https://www.darpa.mil/news-events/2018-10-11 https://www.darpa.mil/news-events/2018-10-11 I recall Tenenbaum's lab had a similar paper a few years back.
- mdp2021 4y agoAlso https://www.machinecommonsense.com/ https://www.machinecommonsense.com/ , in which animations are shown which reveal the close similarity to the DeepMind project.
- suchow 4y agoThe similarity you see between this DeepMind project, the DARPA program, and research in Tenenbaum's lab is not incidental: there's a steady stream of crosstalk and cross-training between machine learning researchers who engineering artificial intelligences and cognitive scientists who reverse-engineer human intelligences. (Note, for example, that Peter Battaglia, one of the co-authors of this DeepMind project, was a postdoc with Tenenbaum.)
- ShamelessC 4y agoThat scans with observations from recent text-to-image works where there often seems to be an insight or two either left without citation or citing an unpublished work that they used to avoid testing an (ultimately) incorrect hypothesis. I have seen some suggest that this is basically Google “allowing” the competition to catch up just to beat them a few weeks later but generally it just seems like they’re kind of all chatting with each other in the background instead.
- thomasjudge 4y agoI feel like there is an inferential leap implied, to greatly simplify, from "A does X and B does X" to "A and B must operate relevantly similarly." For example, walking and flying are both modes of transportation, but you can't really learn anything interesting about one from studying the other
- sebzim4500 4y ago>For example, walking and flying are both modes of transportation, but you can't really learn anything interesting about one from studying the other You can figure out newtonian mechanics entirely on the ground and that clearly helps you understand flight. By analogy, getting more understanding about what limits exist in ANNs could plausibly help understand how the brain works (and vice versa).
- ChikkaChiChi 4y agoOnce you understand that walking gets you from where you are to where you want to be, you start to define the characteristics of motion. Then, seeing other forms of conveyance that are faster underpin the concept of efficiency. Walking and flying may not have a lot in common to you and I, but to a thing learning to crawl, there is a lot to be understood.
- sklargh 4y agoI assure you as the parent of a toddler, young children attempt to find the line of commonality between walking and flying often.
- deleted 4y ago[deleted]
- ggm 4y agoUnderrated comment. This is like a "correlation is not causation" side of "this ML worked so this must be how a brain works" needs to be hit on the head, time and time again. Maybe we can teach an ML to whack-a-mole until we see ideas pop out which the ML doesn't think are repetitive correlation/causation/model-is-working effects
- Jeff_Brown 4y agoData and analysis alone, without experimentation, don't seem like enough to achieve real intelligence. From its title this article sounded like it would be about progress in learning by doing. Alas, it's not.
- mdp2021 4y ago> experimentation Right. "You have to tell yourself stories", as the late Prof. Patrick Winston said (you are intelligent because you can predict the unexperienced). Because you need concept development and critical thinking - an active process.
- mjburgess 4y agoI think publishing in AI now seems to be a game of how much pseudo-psychological BS can be spread over a training a regression model. If you do it well, apparently, you win being published in Nature.
- mdp2021 4y agoNot only while some are contented with AI solutions for very specific problems, like the optimal colour for bottlecaps, some are still keeping the ideal of progress towards AGI very present; but also the idea and practice of finding new tricks that may help the whole field remains there. This research seems to have found a shortcut strategy - a faster ML.
- jonbaer 4y agoLooking at the photo I don't think the AI is going to realize eating the piece it is about to pick up and it will choke. I would actually like to see more reinforcement learning agents like that, the action space on infant movement is quite small so it's even really about "action space discovery" to some point. Things it discovers are way more interesting, like if food were not on the floor/level and it has to stand to get it, it will eventually get there after N attempts (over time), and then if you introduce another agent if learning to block the other agent will award more food, etc, then it discovers 50/50 and equilibriums (better to eat now than wait). PLATO seems like a step in that direction.
- mdp2021 4y agoA further article and a commentary just appeared on The Conversation from a Professor of Psychology and Infant Studies: https://theconversation.com/researchers-trained-an-ai-model-to-think-like-a-baby-and-it-suddenly-excelled-186563 https://theconversation.com/researchers-trained-an-ai-model-... > Typically, AI models start with a blank slate and are trained on data with many different examples, from which the model constructs knowledge. But research on infants suggests this is not what babies do. Instead of building knowledge from scratch, infants start with some principled expectations about objects [...] The exciting finding by Piloto and colleagues is that a deep-learning AI system modelled on what babies do, outperforms a system that begins with a blank slate and tries to learn based on experience alone
- YeGoblynQueenne 4y agoThe interesting thing is that the author of the paper you linked is currently reviewing the paper, or was at the time of writing: >> New research by Luis Piloto and colleagues at Princeton University – which I’m reviewing for an article in Nature Human Behaviour – takes a step towards filling this gap. I don't reckon I've seen this kind of article before: "here's some new research I'm reviewing and I think it's rad". That just sounds so... dodgy. You're supposed to maintain at least the facace of being impartial and having some sort of integrity when making reviews, even when reviewing a DeepMind paper for Nature.
- mikolajw 4y agoClickbait title. I wish ML researchers (EDIT: and engineers and journalists) stopped using anthropomorphizing language. This has decades of solid tradition, but that's no excuse. Any comparison of a machine to a human misleads the public. Machines aren't like babies, artificial neural networks aren't like actual neural networks or brains. Machines shouldn't be given human names (PLATO is a borderline case). I know this is like talking to a wall -- money requires hype -- but still, please stop doing that.
- mdp2021 4y agoIt is not the case - this is just biomimicry: "let us try imitating feats of a living organism". Perfectly legitimate. Nobody is told to make unduly images out of it.
- mikolajw 4y ago"DeepMind AI learns simple physics like a baby" clearly makes an unduly image out of it. Calling it PLATO evokes an image of an ancient human philosopher. No other field uses as many bold comparisons to humans as artificial intelligence (its name alone is one).
- mdp2021 4y agoBut you are supposed "not to evoke": that'd be sensational. "The name of AI": we call "intelligent" in this convention that which finds solutions - normally the natural intelligence of a professional, sometimes the artificial intelligence of a computerized system. As easy as that. It works, no intrinsic issue. This experiment: children seem to rely on expectations in learning and this ANN based system tries to implement some form of "expectation based learning". No problem.
- deleted 4y ago[deleted]
- feral 4y ago> artificial neural networks aren't like actual neural networks or brains Just to zoom right in on neural networks: People often say this, and I never see a solid argument. I know very little about biological neural networks. Clearly they are very different in some respects, for example, meat vs silicon. But I never see a good argument that there's no perspective from which the computational structure is similar. Yes, the low level structure, and the optimization is different, but so? You can run quicksort on a computer made of water and wood, or vaccum tubes, or transistors, and it's still quicksort. Are we sure there aren't similarities in terms of how the various neural networks process information? I would be interested in argument for this claim. After all, the artificial neural networks are achieving useful high level functionality, like recognizing shapes.
- atwood22 4y agoI recently had a child. Watching her learn inspires a sense of amazement. It starts slow with basic grasping, then shaking, then hitting, then tracking, then pointing. You really see how human's learn from first principles. One difference I perceive between a child an a neural network is that it appears a child does not start from a blank slate. The brain of a baby seems to come hard-wired with some basic instinctual functionality like grabbing and object tracking.
- EGreg 4y agoChomsky is that you?
- thomassmith65 4y agoThat joke probably is going over a lot of heads. People associate Chomsky with Manufacturing Consent now. https://en.wikipedia.org/wiki/Verbal_Behavior#Chomsky's_review_and_replies https://en.wikipedia.org/wiki/Verbal_Behavior#Chomsky's_revi...
- random314 4y ago
- staticassertion 4y ago> One difference I perceive between a child an a neural network is that it appears a child does not start from a blank slate. The brain of a baby seems to come hard-wired with some basic instinctual functionality like grabbing and object tracking. I think that's likely, but also babies have ~9 months of development, at least some of that time (3-6 months) they're moving around/ have a brain.
- deltree7 4y agoBabies have Millions of years of development. I still can't believe we start with Babies as base point to start learning. When the babies are born it is almost on auto-pilot (Nature > Nurture)
- 4y ago
- de6u99er 4y agoI think it's impressive what the DeepMind team comes up with, but the inflationary use of the term Artificial Intelligence is annoying. This should be reserved to something that is truly intelligent. As long as this has not been achieved it's just simply a well trained model that results in high accuracy predictions for very narrowly defined tasks.
- fny 4y ago
- mdp2021 4y ago> This should be reserved to something that is truly intelligent No. I had to write this so many times. It's pretty clear: at some point, we decided "Engineer, if you come up with a solution we will call you intelligent, and if your algorithm does we will call it intelligent as well". There exists an interpretation of the term that makes the term sound. It's pretty clear, really - and that "intelligence [tongue-in-cheek] [of specific solvers]" is _not_ "[intellectual] Intelligence", which by the way is not even the last and highest meaning of it. It is the second time in this very page: «we call "intelligent" in this convention that which finds solutions - normally the natural intelligence of a professional, sometimes the artificial intelligence of a computerized system».
- arriu 4y agoAnyone know whether we’ve crossed the boundary on “the next Einstein will be an AI”? Specifically, do scientists believe the next breakthroughs will come from humanity or are we waiting for AI at this point?
- trashtester 4y agoA similar question would be: "Has the last human that will make 'Einstein' level discoveries already been born?" This leaves room for some 10 year old to do so in the near future, but places some kind of event horizon for AI achievement eclipsing human achievement closer than about 25 years into the future.
- mdp2021 4y agoAt this stage the most relevant tools aiding research (unless I missed something discreet) have the long-known issue of "transparency", or lack thereof, or that solutions may work but for the growth of knowledge your actual interest would be "how and why". For AGI, you will have to wait.
- dilan-dio4 4y ago
- alberth 4y agoWas Skynet just born?
- avnigo 4y agoThis reminds me of BabyX [0][1], not sure on how different DeepMind's implementation is. [0]: https://www.soulmachines.com/resources/research/baby-x/ https://www.soulmachines.com/resources/research/baby-x/ [1]: https://en.wikipedia.org/wiki/BabyX https://en.wikipedia.org/wiki/BabyX
- YeGoblynQueenne 4y agoActual nature article: Intuitive physics learning in a deep-learning model inspired by developmental psychology https://www.nature.com/articles/s41562-022-01394-8.pdf https://www.nature.com/articles/s41562-022-01394-8.pdf
- YeGoblynQueenne 4y agoHaving read the paper: They evaluated their model by producing a test set with videos spliced so as to compose physically "impossible" sequences (that's the claim anyway - who knows how "impossible" those sequences are). Then they measured the trained network's prediction error on the spliced videos and they called that "surprise", implying that it is somehow similar to the "surprise" shown by human babies when they observe physically impossible sequences (to clarify, in the psych literature this "surprise" is measured as a function of the time spent looking at a scene). Then they measured "accuracy" as the difference in "surprise" between possible and impossible videos. There are two problems with this. First, it's the old switcheroo: it just relabels prediction error as "surprise". Yeah, "surprise" is interpreted, in a Bayesian setting, as the difference between an expected event and an actually occuring event but here we're not in Bayesian world. There's just a classifier failing to classify correctly. By the same token, any classifier's classification error ever can be interpreted as "surprise", even though it's just failure to acquire the target concept. Second, this measure of "surprise" has nothing to do with the measure of surprise used in experiments with baby humans, where "surprise" is a function of the time the baby spends looking at a scene. For a baby human it makes sense to intrepret longer time looking as a double-take: "what the hell just happened"? But for a neural net? How can a neural net do a double-take? First of all the time spent "looking" at any image is entirely controlled by the experimenters. This is just an apples-to-oranges comparison and the result is a lemon. Third, their "flat" networks trained without hand-crafted object segmentation show lower "surprise" but since that's just the sum of squared errors, it only means that the flat networks have learned classifiers that perform better on the test set than the proposed approach. When "accuracy" is compared, the flat networks score lower but that should be expected: if "accuracy" is measured as the difference in classification error, the model that is better at classifying across all tasks should have lower "accuracy". But that's because it has higher classification accuracy. (yeah, that's an off-by-one error, well spotted). Then, to test whether their system generalises to unseen objects and events, they tested it on a separate dataset, called ADEPT, and found that it scores very well. The only problems is that they measured "accuracy" again as the difference in mean squared errors between "possible" and "impossible" scenes. All this is measuring is the _lack_ of generalisation from training to test images. I'm sorry to be so negative, again, but all I see here is playing with language and rechristening error as "surprise" and "accuracy". There is nothing that shows acquisition of "intuitive physics" like the paper keeps claiming.