9 ms·
AI, Deep Learning, and Machine Learning: A Primer [video]
- gavanwoolery 10y agoInteresting to see the amount of "winters" AI has gone through (analogous, to a lesser extent, to VR). I see increasing compute power, an increased learning set (the internet, etc), and increasingly refined algorithms all pouring into making the stuff we had decades ago more accurate and faster. But we still have nothing at all like human intelligence. We can solve little sub-problems pretty well though. I theorize that we are solving problems slightly the wrong way. For example, we often focus on totally abstract input like a set of pixels, but in reality our brains have a more gestalt / semantic approach that handles higher-level concepts rather than series of very small inputs (although we do preprocess those inputs, i.e. rays of light, to produce higher level concepts). In other words, we try to map input to output at too granular of a level. I wonder though if there will be a radical rethinking of AI algorithms at some point? I tend to always be of the view that "X is a solved problem / no room for improvement in X" is BS, no matter how many people have refined a field over any period of time. That might be "naive" with regards to AI, but history has often shown that impossible is not a fact, just a challenge. :)
- RockyMcNuts 10y ago1) sounds like exactly what deep learning is...map more complex abstractions in each succeeding layer 2) are computers that can understand speech, recognize faces, drive cars, beat humans at Jeopardy really 'nothing at all like human intelligence?'
- gavanwoolery 10y ago1) I am aware of deep learning, and the improvements made circa 2012 or so, but it is still ultimately failing to make advanced correlations between differing training sets, a strong memory, and a meaningful distinction between high-level abstractions and low-level inputs (although all these things are being addressed in one way or another with incremental improvements). And also effectively sharing learned data among separate entities or reteaching it. 2) These things are all very human-like, but they are still sub-problems IMHO :)
- Joof 10y agoThis reminded me that there are other NN variants that might help provide some clues in that direction. Hopfield nets for example provide associative memory. It may not all be groundbreakingly efficient, but very worthwhile.
- gavanwoolery 10y agoYep - also we have a large tendency to use feedforward NNs right now, but I have a sneaking suspicion that the future lies in something closer to recurrent NNs. Or probably something more complex, like automata-ish properties (IIRC there is also some NN that uses Turing-like devices).
- eli_gottlieb 10y agoNah. If we want properly humanlike AI software, we're going to have to find a way to make inference in probabilistic programs a lot faster.
- throwawaysocks 10y ago> 1) sounds like exactly what deep learning is...map more complex abstractions in each succeeding layer Only at such a high level of abstraction as to be meaningless. > 2) are computers that can understand speech, recognize faces, drive cars, beat humans at Jeopardy really 'nothing at all like human intelligence?' They are not. Hundreds of man years worth of engineering time go into each of those systems, and none of those systems generalizes to anything other than the task it was created for. That's nothing like human intelligence.
- jimfleming 10y ago> Only at such a high level of abstraction as to be meaningless. I'm not sure what this means or how the abstractions are meaningless? From Gabor filters to concepts like "dog", the abstractions are quite meaningful (in that they function well), even if not to us. > They are not. Hundreds of man years worth of engineering time go into each of those systems, and none of those systems generalizes to anything other than the task it was created for. That's nothing like human intelligence. This isn't strictly true if we look at the ability to generalize as a sliding scale. The level of generalization has actually increased significantly from expert systems to machine learning to deep learning. We have not reached human levels of generalization but we are approaching. Consider that DL can identify objects, people, animals in unique photos never seen before and that more generally the success of modern machine learning is it's ability generalize from training to test time rather than hand engineering for each new case. Newer work is even able to learn from just a few examples[0] and then generalize beyond that. Or the Atari work from DeepMind that can generalize to dozens/hundreds of games. None of those networks are created specifically for Break Out or Pong. It's also not entirely fair to discount the hundreds of years of engineering considering most of these systems are trained from scratch (randomness). Humans, however, benefit from the preceding evolution which has a time scale that far exceeds any human engineering effort. :) [0] https://arxiv.org/abs/1605.06065 https://arxiv.org/abs/1605.06065
- bobdole1234 10y agoWe spend a lifetime building the skills that we use in our day to day lives. And most of them don't transfer.
- jimfleming 10y agoFor #2 you've touched on the "AI Effect"[0] or moving goal posts. [0] https://en.wikipedia.org/wiki/AI_effect https://en.wikipedia.org/wiki/AI_effect
- daveguy 10y agoAt some point a consensus of AI researchers will decide that we have a generally intelligent system (able to adapt and learn many tasks, pass a legitimate turing test, etc). Currently there are zero AI researchers that would claim such a thing even with our current breakthroughs in specialized tasks. The moving goalpost has been less an issue of "what is AI" and more an issue of "what are difficult task at the edge of AI research". People with passing interest (even most programmers) don't distinguish between the two. Of course "difficult tasks in AI research" is a moving goalpost and it will be moving until we achieve general intelligence and beyond. This is a requirement for progress in AI research. If those goalposts stop moving before we have a general intelligence then something is wrong in the field. When researchers (not the general public) start arguing whether the goalposts should be general intelligence or super intelligence that is when we know we have traditional AI. When we try to figure out how to get adult human level intelligence to take hours or days to train on the top supercomputers rather than months or years -- that is when we have AI. Even then, if the training part requires that much computational intensity, how many top supercomputers are going to be dedicated to having a single human level intelligence? You could train current algorithms used in AI research for decades and have nothing resembling general human intelligence.
- jimfleming 10y agoI agree, but I guess my point (in this comment and others) would be that we should stop thinking of intelligence, consciousness, free-will and other attributes as a hard line but rather gradients or quantities.
- Cybiote 10y agoRealize that the computer's advantages can also lead to weaknesses. By this, I mean that a computer's powerful and precise memory means that it is better able to work off raw correlations, without as much of a need to abstract or seek out causal models. While this might turn out okay for detailed large but ultimately simple (stationary) patterns, it will not be so advantageous in more dynamic settings or scenarios with multiple levels of organization with differing dynamics.
- selectron 10y agoHuman intelligence is basically the ability to solve a large collection of sub-problems. As models learn how to solve more and more sub-problems they become closer and closer to human intelligence. Right now the focus is on solving important specific sub-problems better humans, rather than the ability to solve a much wider variety of sub-problems. Machine learning and human learning happen in much the same way. We have a dataset of memories, and we have a training dataset of results. We then classify things based on pattern matching. The current human advantage is an ability to store, acquire and access certain kinds of data more efficiently, which helps in solving a wider variety of problems. For problems in which machines have found out how to store, acquire and access data more efficiently (such as chess) machines are far superior to humans.
- gavanwoolery 10y agoThis is basically strong AI vs weak AI. I don't know what the ultimate solution is - it could be exactly as you describe. :) My theory is just that it will need to be generally applicable, on domains it is not trained on, if it is to reach human-level intelligence.
- selectron 10y agoHuman-level intelligence is not generally applicable on domains it is not trained on, so holding AI to this standard is ridiculous. Humans need to be taught just like machines do.
- gavanwoolery 10y agoYes, but there is cross-over of domains. For example, say you learned how to ride a bicycle. This might aid you in how fast you learn to ride a motorcycle, or vice versa. (Might be a bad example but I hope it illustrates the point)
- pinouchon 10y agoYou are referring to transfer learning
- autokad 10y agoWe will be closer to cracking neural nets and are closer to the singularity when we can train a net on two completely different tasks and each task can make other predictions subsequently better. IE: train / test it on spam / ~ spam emails, then train the same net with twitter data male / female.
- gavanwoolery 10y agoI agree - this would be general intelligence. You can adjust weights for one problem very specifically to some degree of success, but having that affect a different slightly related problem (and even being able to distinguish between two differing problems) is going to require some rethinking, or enormous compute power exponentially beyond what we have now.
- nl 10y agoYou can do this now(?!) In fact something as simple as naive Bayes will work reasonably well for that. I'm not sure if you are aware, but in (say) image classification it's pretty common to take a pre-trained net, lock the values except for the last layer, and then retrain that for a new classification task. You can even drop the last layer entirely and use a SVM and get entirely adequate results in many domains. Here's an example using VGG and Keras: http://blog.keras.io/building-powerful-image-classification-models-using-very-little-data.html http://blog.keras.io/building-powerful-image-classification-... And here a similar thing for Inception and TensorFlow: https://www.tensorflow.org/versions/r0.8/how_tos/image_retraining/index.html https://www.tensorflow.org/versions/r0.8/how_tos/image_retra...
- dharma1 10y agoTransfer learning at the moment works within one domain (say images), because the low level shapes are still similar, but not between different domains of data
- nl 10y agoSure, that's what I was pointing out. However: Zero-Shot Learning Through Cross-Modal Transfer http://arxiv.org/abs/1301.3666 http://arxiv.org/abs/1301.3666
- KasianFranks 10y agoAI is very fragmented. Biomimicry has always been the way forward in every industry and Stephen Pinker made good head way from my vantage. https://www.google.com/webhp?sourceid=chrome-instant&ion=1&espv=2&ie=UTF-8#q=stephen%20pinker%20how%20the%20mind%20works https://www.google.com/webhp?sourceid=chrome-instant&ion=1&e... https://www.google.com/webhp?sourceid=chrome-instant&ion=1&espv=2&ie=UTF-8#q=computational%20theory%20of%20the%20mind https://www.google.com/webhp?sourceid=chrome-instant&ion=1&e... Saira Mian, Micheal I. Jordan (Andrew Ng was a pupil of his) and David Blei were not mentioned in this video so they are off the mark a bit. Vector space is the place. https://www.google.com/webhp?sourceid=chrome-instant&ion=1&espv=2&ie=UTF-8#q=michael+jordan+deep+learning https://www.google.com/webhp?sourceid=chrome-instant&ion=1&e... AI has become the most competitive academic and industry sector I've seen. Firms like Andreessen are trying to understand the impact during this AI summer and they should be applauded for this. One of the keys to AI is found here: https://www.google.com/webhp?sourceid=chrome-instant&ion=1&espv=2&ie=UTF-8#q=split%20brain https://www.google.com/webhp?sourceid=chrome-instant&ion=1&e... Deep learning has very little to do with how the brain and mind work together. In the video the highlight on ensemble (combinatorial) techniques are a big part of the solution.
- gavanwoolery 10y agoMore direct link to Split-brain as it applies to computing: http://en.wikipedia.org/wiki/Split-brain_(computing) http://en.wikipedia.org/wiki/Split-brain_(computing) Also, thanks for that term! Was not aware of it, but very useful to describe what I think is one of the big problems.
- deleted 10y ago[deleted]
- KasianFranks 10y agoYes, split brain approaches in general computing are very interesting and I think, over lap some approaches in ai-based computational combined with neuroscientific efforts.
- _yosefk 10y ago
- deleted 10y ago[deleted]
- epberry 10y agoPretty basic stuff - the history portion was more interesting than any of the content that followed. Anyone who's been paying the slightest attention in the last few years will be familiar with all of the examples used in the podcast. On a side note I always admire the polish of the content that comes out of a16z - its typically very well put together.
- 31reasons 10y agoOne of the main challenges in Deep Learning is that it requires massive amounts of data, orders of magnitude more data than a human toddler to detect a cat. It could be a great area of research on how to reduce the amount of data it takes to train the network. One main thing it lacks is imagination. Humans can learn things and can imagine different combinations of those things. For example, if I ask you to imagine a Guitar playing Dolphin, you could imagine it and even recognize it from a cartoon even though you have never seen it in your life before. Not so for Deep Learning, unless you provide massive amount of images of Dolphins playing guitars.
- rando18423 10y agoIn a way, I think you just described the fundamental difference between "intelligence" and "very advanced applied statistical analysis." :)
- pawelwentpawel 10y agoInteresting! Made me wonder - how would we compare the data that neural net receives with the data that toddler's visual cortex is getting? On a purely visual level - let's say we have 10k of static 32x32 images defining a class of cat. Or even more of them plus some negative examples. Each image is a different cat, in a different position (they're incredibly flexible creatures). Having so many cases we should be trying to make some kind of a generalization of what 1024 pixels of a cat should look like. A family with a toddler has only one cat. From that one example, he learns the concept of what a cat is and is able to generalize it when in different situations. But a toddler has 2 eyes, his visual input is stereo. Even if he sees just one cat, it's not a static image interaction. The input is temporal, he can see the cat moving and interacting with the environment.
- vj_2016 10y agohttp://www.videojots.com/davos/state_of_ai.html#2181 http://www.videojots.com/davos/state_of_ai.html#2181 Apparently, robots still struggle to pick up things?
- cs702 10y agoThis is an opinionated video that tries to rewrite history. For example, according to it, the "big breakthrough" with deep learning occurred in 2012 when Andrew Ng et al got an autoencoder to learn to categorize objects in unlabeled images. WHAT? Many other researchers were doing similar work years earlier. According to whom was this the "big breakthrough?" The video at least mentions Yann LeCun's early work with convnets, but there's no mention of Hinton et al's work with RBMs and DBNs in 2006, or Bengio et al's work with autoencoders in 2006/2007, or Schmidhuber et al's invention of LSTM cells in 1997... I could keep going. The list of people whose work is insulted by omission is HUGE. I stopped watching the video at that point.
- raverbashing 10y agoYeah. Between LeCunn and the Google experiment a lot of things happened Not to mention the use of ReLu and understanding of the Vanishing Gradient issue
- pinouchon 10y agoOmitting the other members of the LBH conspiracy and Schmidhuber is unfortunate, but I agree with the idea that the number one reason deep learning is working now is scale. Hinton also says it himself, for example (at 5m45 in the video below): "What was wrong in the 80 was that we didn't have enough data and we didn't have enough compute power. [...] Those were the main things that were wrong". He gives a "brief history of backpropagation" here: https://youtu.be/l2dVjADTEDU?t=4m35s https://youtu.be/l2dVjADTEDU?t=4m35s
- lars 10y agoI agree that scale is an important factor in deep learning's success, but that Google experiment ended up being a good example of how not to do it. They used 16000 CPU cores to get that cat detector. A short while later, a group at Baidu were able to replicate the same network with only 3 computers with 4 GPUs each. (The latter group was also lead by Andrew Ng.)
- espadrine 10y ago
- deleted 10y ago[deleted]
- justsaysmthng 10y agoFrom the presentation: "There's a lot of talk about how AI is going to totally replace humans... (But) I like to think that AI is going to actually make humans better at what they do ..." Then immediately he continues that "So it turns out that using deep learning techniques we've already gotten to better than human performance [....] at these highly complex tasks that used to take highly, highly trained individuals... These are perfect examples of how deep learning can get to better than human performance... 'cause they're just taking data and they're making categories.." I think that brushing off the dramatic social changes that this technology will catalyze is irresponsible. One application developed by one startup in California (or wherever) could make tens of millions of people redundant all over the world overnight. How will deep learning apps affect the healthcare systems all over the world? What about IT, design, music, financial, transportation, postal services... nearly every field will be affected by it. Who should the affected people turn to ? Their respective states ? The politicians ? Take up arms and make a revolution ? My point is that technologists should be ready to answer these questions. We can't just outsource these problems to other layers of society - after all, they're one step behind the innovation and the consequence of technology is only visible after it's already deeply rooted in our daily habits. We should become more involved in the political process all over the world (!) - at least with some practical advice to how the lawmakers should adapt the laws of their countries to avoid economic or social disturbances due to the introduction of a certain global AI system.
- vonklaus 10y agoI just listened to Altman discussing this at a recent interview and it is obviously something he thought a lot about. If you can't watch the video he says that ai is an amazing resource and YC is funding a basic income study in oakland as well as open ai. He also points out that doing a task that a machine or computer do is pointless. I find myself agreeing with what I believe his conclusion was; we (humans) want ai and will all be better off for it. we are heading into a shift on the order of the industrial revolution and the best course is unknowable. we should harness this technology, try to distribute it bu collaborative building & information dissemination and study the idea of personal fullfillment & a basic quality of life. In short, the answer is definitely not to stop working on it because it is just basic game theory that someone/entity will not. We need to leverage to fix the problem it creates & learn how to allocate our resources by studying this immeadiately. http://m.youtube.com/watch?v=FuijDaj8DvA http://m.youtube.com/watch?v=FuijDaj8DvA
- aficionado 10y agoBasically this video ignores the history of machine learning in general. Jumping from Expert Systems to Neural Networks and Deep Learning is actually ignoring 36 years (and billions of dollars) of research http://machinelearning.org/icml.html http://machinelearning.org/icml.html (Breiman, Quinlan, Mitchell, Dietterich, Domingos, etc). Calling 2012 the seminal moment of Deep Learning is quite hard to digest. Maybe it means that 2012 is the point in time when the VC community discovered machine learning? Even harder to digest is calling Deep Learning the most productive and accurate machine learning system. What about more business oriented domains (without unstructured inputs), the extreme difficulties and expertise required to fine tune a network for a specific problem, or some drawbacks like the ones explained by http://arxiv.org/pdf/1412.1897v2.pdf http://arxiv.org/pdf/1412.1897v2.pdf or http://cs.nyu.edu/~zaremba/docs/understanding.pdf http://cs.nyu.edu/~zaremba/docs/understanding.pdf. Those who ignore history are doomed to repeat it. As Roger Schank pointed out recently http://www.rogerschank.com/fraudulent-claims-made-by-IBM-about-Watson-and-AI http://www.rogerschank.com/fraudulent-claims-made-by-IBM-abo..., another AI winter is coming soon! Funny that the video details the three first AI winters but the author doesn't realize that this excessive enthusiasm in one particular technique is contributing to a new one!
- gavanwoolery 10y agoFirst, would have to agree that there is quite a bit of history being ignored, but I suspect this deck is more to excite and interest investors than anything else. The value of AI depends largely on perceived value IMHO, and the frequency of "winters" will correlate with that. I think we are still a bit too early for VR to really take off, but that did not stop a $2b acquisition and loads of investor interest. This will probably artificially constrain what should be an AI winter right now, just because so much money is continuing to go into it. I personally applaud that so much enthusiasm is going into AI right now, and though we are repeating history to some extent I still think we are making incremental advancements (however small) - even if this just means applying old AI techniques to new advancements in hardware.
- deprave 10y agoI think you're spot on with the observation that 2012 refers to when VCs discovered machine learning. Anyone who has recently interacted with VCs will tell you that they look for anything to do with machine learning (and VR/AR/MR), even when it makes no sense. There are going to be some companies who will be able to leverage machine learning to advance their business, namely, Google/Facebook who will probably claim they can offer better targeted advertising and such. Most other players who merely try to force machine learning on other fields are likely to realize that while the technology is cool, it's still too early for it to be generally applicable to "any" problem. Especially dangerous is going to be the mix of machine learning with healthcare. I believe Theranos tried it and found out it's not that easy... I'd watch this space with skepticism.