12 ms·
Go, Marvin Minsky, and the Chasm That AI Hasn’t yet Crossed
- splatcollision 11y agoInteresting read & puts the Google Go bot in some needed perspective. From the article: > In the real world, the answer to any given question to be just about anything, and nobody has yet figured out how to scale AI to open-ended worlds at human levels of sophistication and flexibility. One doesn't have to shoot for the moon in order to find useful applications for AI or Cognitive technology. If you can restrict the domain of knowledge of an expert system, it doesn't need to be create 'open-ended worlds' in order to provide value. It just has to beat human effort, or be an augmentation to human cognition to enable scale, for it to be useful - or provide business value.
- stcredzero 11y agoMaybe we should take a cue from John Searle and consider AI an extension of human intelligence? Often, what we call "AI" is really a codification, automation, and scaling of human intelligence. Machine translation is a good example of this.
- frozenport 11y agoBut then why call it AI? Perhaps the work that it does is not actually intelligent?
- splatcollision 11y agoExactly. AI is such a loaded term with high expectations...
- ktRolster 11y agoMore people need to be aware of the distinction between "strong AI" and "weak AI." Right now, all we have is weak AI.
- empath75 11y agoIs what people do 'actually intelligent'? If you break down the processes of the brain to a low enough level, all of the 'intelligence' will disappear, just as it does in a computer neural network. Intelligence is not some kind of aristotelian substance that permeates brain matter. At some level, anything which is intelligent has to be built from parts which are not intelligent.
- eanzenberg 11y agoThat's right, yet "I think therefore I am." I can prove that I exist and have conscious thought beyond your observation that the my actions are low-level survival instincts. I would define intelligence as knowing "I think therefore I am." Unfortunately, it's impossible (as far as I know) to prove for anyone outside myself :)
- colllectorof 11y ago> Is what people do 'actually intelligent'? Yes, although there are plenty of people trying to convince everyone otherwise by example. > If you break down the processes of the brain to a low enough level, all of the 'intelligence' will disappear, just as it does in a computer neural network. If you break matter down to low enough level, everything is just elementary particles. Now, would you please trade me some gold for equal mass of aluminum?
- eli_gottlieb 11y ago>If you break down the processes of the brain to a low enough level, all of the 'intelligence' will disappear, just as it does in a computer neural network. Well no. Free-energy minimizing, multi-information maximizing generative causal modeling is what appears when you break down the processes of the brain (at least as we best understand them right now).
- nsns 11y agoAlso, doesn't each human require some 20-30 years of training from birth in order to be able to answer such questions? This fact seems to be constantly ignored.
- maxerickson 11y agoA 5 year old can figure out an awful lot. The 20 to 30 years is what it takes to get to where you are thinking about something new to humanity.
- _yosefk 11y agoHumans do require training, they're slow, they sleep, rest, lose concentration, vary greatly in performance etc. All true and economically significant. That is however distinct from no machine being able to do some of the things humans do as of now. It just means that most things they can do, they do better than humans. But first they must be able to do it.
- SixSigma 11y agoShoot for the moon! Even if you miss you'll end among the cold, dead vacuum of space.
- justicezyx 11y agoBeating the world's 663th go player is not mastering the game... I guess AI has to purge human out from earth to justify the statement "AI masters xxxx"...
- sago 11y agoThe superhuman fallacy is the nemesis of all AI research: if it isn't better than the best human who has ever attempted a problem, it is worthless and derisory. I've done a lot of work on artificial creativity, and am constantly thrilled when code generates something at the level of a creative 3rd grader. But show it to most people and you get "It's hardly a Michaelangelo, is it?" Frustrating.
- Mark222 11y agoNo, it's rather the idea that you cannot say "AI beats Go master" or "AI masters Go" if it didn't actually attain some sort of high ranking by itself. Beating a low-ranked player while still interesting is not necessarily a proof of proficiency but could be due to just blind luck for example.
- NhanH 11y agoThere are about 1500 chess players with the title "Grandmaster", and a whole lot more for various other "Master" title. That is to say that a player ranking within the top 1000 of a game like Go is a master of the game. A human player will take 10 years and way north of 10000 hours to get to where AlphaGo is.
- thangalin 11y agoWinning 5 games to 0 probably isn't blind luck. There's no clear definition of "mastery." Honinbō Shusaku was a master. Honinbō Shūsai, Go Seigen, and Minoru Kitani would also be considered masters. As time marches on, average player skill increases. While Honinbō Shusaku was among the strongest players of his day, he would be hard pressed to hold his own against professionals in today's era. I think it's fair to say that anyone who reaches shodan (1 dan professional) plays at the master level. The difference between 1 dan professional (1P) and 9 dan professional (9P) is three stones, or roughly 30 points. In amateur play, for comparison, the difference between a 1 dan and 3 dan is about 2 stones (roughly 20 points). AlphaGo won 5 straight games against a 2 dan professional player. That puts AlphaGo around 3P, well into the master range. In Go, the ranks are: 30 kyu amateur (never played) 1 kyu amateur (understands the game) 1 dan amateur (mastered the basics) 7 dan amateur (nearly professional strength) shodan (1 dan professional) 9 dan (top ranking professional) https://en.wikipedia.org/wiki/Go_ranks_and_ratings#Professional_ranks https://en.wikipedia.org/wiki/Go_ranks_and_ratings#Professio... https://en.wikipedia.org/wiki/Go_professional#Discrepancies_among_professionals https://en.wikipedia.org/wiki/Go_professional#Discrepancies_... "Traditionally it has been uncommon for a low professional dan to beat some of the highest pro dans. But since the late-90s it has slowly become more common."
- shas3 11y agoInteresting article! However, Deep Blue, Watson, and AlphaGo are very different from one another. I don't think anyone deemed beating humans at chess or jeopardy impossible at the time Deep Blue and Watson were built. On AlphaGo the point about generalizing AI is valid, yet I think the author doesn't fully appreciate the novelty of approach described in the AlphaGo paper. Their work advances the field, has more general utility than Deep Blue's chess or Watson's jeopardy programs. AlphaGo paper specifically represents an advance in machine learning algorithms for games in general. As I understand, Watson's new NLP algorithm is PRISMATIC [1]. PRISMATIC is a rule-based NLP system and AlphaGo is more statistical inference/neural networks. Even if AlphaGo's 'policy-network- value-network' framework is not too generalizable, the philosophical implication is that we can build AIs that can mimic 'human intuition'. Jeopardy and chess have lesser components of 'human intuition' than Go. They are apples and oranges. So, I wonder if the author errs in bringing Deep Blue and Watson-Jeopardy into the picture. In my opinion while Watson-Jeopardy and Deep Blue were 'over-fitting' for Jeopardy and chess respectively, AlphaGo algorithms are more general and over-fits for the larger category of 'games'. [1] http://brenocon.com/watson_special_issue/05%20automatic%20knowledge%20extration.pdf http://brenocon.com/watson_special_issue/05%20automatic%20kn...
- jmilloy 11y agoI really think Gary agrees with you, and you're just picking an unnecessary fight. Having advocated for this kind of approach decades ago, he fully appreciates the novelty of the approach. He points out the simplicity of Jeopardy and Chess as reasons why they haven't translated to the real world well, and maintains optimism about DeepMind. I don't read "the real question is whether the technology developed there can be taken out of the game world and into the real world" as a criticism, but praise; the question is worth considering, whereas so often it is not.
- shas3 11y agoI don't intend to pick a fight. I am pointing out one deficiency I perceive in this widely shared article. On the philosophical questions: I think even with the greatest technological advances, the question remains: will we adopt AI? I have seen too many situations where machine learning is not adopted even though algorithms can enable great functionality: usually the reason is lack of financial incentives or simple entrenched human interests (low-grade Ludditism). This resistance will lead to more (to use terminology from the AI debate) paperclip maximizers and fewer general AIs. This is already happening, the future of 2001 didn't happen to be HAL 9000, but an ingenious model and linear algebra algorithm to deliver better search results.
- sixQuarks 11y agoIt's fascinating that nature has created human-level intelligence using blind randomness, albeit over a period of 1+ billion years. My theory is that with renewed global focus on AI, we're going to have a lot of minds looking at this problem from various outside perspectives. I believe a breakthrough in AI will come about not from the computer science sphere, but a very unlikely area that will surprise many.
- nairboon 11y agoWhat would your guess be for that area?
- sixQuarks 11y agoBiology would be the "obvious" answer, but more specifically, I could see a breakthrough coming from psychedelic research, which is making a huge comeback right now after decades of ridicule. It's amazing how little research has been conducted in this area, a lot of scientists are rediscovering and relearning things that were first explored back in the 60s, and there's already been lots of progress related to human psychology.
- tim333 11y agoDeep Mind are working on the biology thing and more specifically study of the human brain. Demis Hassabis, the main guy at Deep Mind did a PhD in cognitive neuroscience and is focused on that stuff. Not so sure about psychedelic research - I don't know how you'd use that to build computer systems even if the Google dream pictures are pretty trippy looking. (https://www.google.com/search?q=google+dreams&num=20&tbm=isch&tbo=u&source=univ&sa=X&ved=0ahUKEwj41bDriNvKAhXDuo4KHZxNC40QsAQIHw&biw=1093&bih=478 https://www.google.com/search?q=google+dreams&num=20&tbm=isc...)
- sixQuarks 11y agoActually, you just brought up a great point. The Google dream pictures are very similar to what you might see during a psychedelic experience. I admit I don't know how psychedelic research could help in building AI, I'm just saying that my hunch is that a breakthrough in AI will come about from left field somewhere.
- seanwilson 11y agoSo now that computers are getting good at Go, what's the next logical stepping stone for AI?
- ktRolster 11y agoAI chess that actually thinks like a human: http://www.popularmechanics.com/technology/robots/a17339/chess-engine-plays-against-itself/ http://www.popularmechanics.com/technology/robots/a17339/che... If you could get a chess engine that can prune the tree as efficiently as a human, while calculating as fast as a computer, it would be phenomenal.
- te 11y agoAfter reading the DeepMind paper, it does seem like their techniques could also be applied to chess and could possibly improve the state-of-art there as well. It is unclear, however, how much improvement remains in modern chess engines. They are already phenomenal.
- unabridged 11y agoDeterministic games with limited information, for example Stratego.
- joseraul 11y ago> AlphaGo isn’t a pure neural net at all — it’s a hybrid, melding deep reinforcement learning with one of the foundational techniques of classical AI — tree-search Most board game computer players use some sort of tree search followed by evaluation at the leaves of the tree. What we discovered in the 70s is that you don't need to have human-level evaluation to win at chess; it is enough to count material and piece activity, plus some heuristics (pawn structure, king safety...); computers more than compensate this weakness with their superhuman tree exploration. This approach never worked so well for Go because evaluation was a mystery: which group is weak or strong? how much territory will their power yield? These are questions that professionals answer intuitively according to their experience. With so many parts of the board that depend on each other, we don't know how to solve the equation. It looks like AlphaGo is the first one to get this evaluation right. At the end of the game, his groups are still alive and they control more territory. So Go evaluation is yet another task that used to be reserved to human experts and that computers now master. The fact that this is mixed with classical tree search does not make it less impressive.
- joe_the_user 11y agoComputer Go actually had advanced a long way by using Monte Carlo Tree Search in particular. The pre-AlphaGo programs that AlphaGo defeated were much stronger than computer Go programs from before the era of Monte Carlo tree search. Computer Chess was not achieved instantly by applying generic "tree search" but required quite a bit of tweaking to the various algorithms which were applied.
- shoo 11y agoI agree that the main strength of AlphaGo seems to be evaluation, using supervised learning + reinforcement learning. What I found interesting about AlphaGo's final algorithm is that there are so many different methods being used at once: 0. there's the monte carlo tree search. while this is definitely a "classic" tree search, this particular tree search algorithm is a fairly recent development, and relies heavily on statistics, which is perhaps somewhat less classical 1. the policy function approximation they use in the final algorithm, aka the policy network, is based on supervised learning + deep network model. but it is NOT the other policy network in the paper that was further tuned used reinforcement learning - that one made the overall system perform worse! 2. the value function approximation they use in the final algorithm isn't just a network. it's a linear combination of a network and a rollout approximation using a much weaker, faster, simpler evaluation function trained on different features. they find the system performs best when each is given an equal weight. 3. from what i understand, the value network is trained (at huge computational cost, particularly in generating the data set required) to give similar accuracy to the value function one could define by using the reinforcement-learning policy network. the value network gives similar valuations but runs 1500x faster. in some sense this isn't terribly algorithmically interesting - it is just an implementation detail to give faster results at game-time at the cost of a ridiculous amount of offline computation.
- Animats 11y agoI went through Stanford in the 1980s, just as it was becoming clear that logic-based AI had hit a wall. That was the beginning of the "AI Winter", which lasted about 15 years. Then came machine learning. AI used to be a tiny field. In the heyday of McCarthy and Minsky, almost everything was at MIT, Stanford, and CMU, and the groups weren't that big. There were probably less than 100 people doing anything interesting. Also, the total compute power available to the Stanford AI lab in 1982 was about 5 MIPS. Part of what makes machine learning go is sheer compute power. Training a neural net is an incredibly inefficient process. Many of the basic algorithms date from the 1980s or earlier, but nobody could hammer on them hard enough until recently. Back in the 1980s, John Koza's group at Stanford was trying to build a cluster out of a big pile of desktop PCs. Stanford got a used NCube Hypercube with 64 processors (1 MIPS, 128KB each). The NCube turned out to be useless. There was a suspicion that with a few more orders of magnitude in crunch power, something might work, but with the failure of AI, nobody was going to throw money at the problem. At last, there are profitable AI applications, and thus the field is huge. Progress is much faster now, just because there's more effort going in. But understanding of why neural nets work is still poor. Things are getting better; the trick of using an image recognition neural net to generate canonical images of what it recognizes finally provided a tool to get some insight into what was going on. At last there was a debug tool for neural nets. Early attempts in that direction determined that the recognizer for "school bus" was recognizing "yellow with black stripe", and that some totally bogus images of noise would be mis-recognized. Now there are somewhat ad-hoc techniques for dealing with that class of problems. The next big issue is to develop something that has more of an overview than a neural net, but isn't as structured as classic predicate-calculus AI. One school tries to do this by working with natural language; Gary Markus, the author of the parent article, is from that group. There's a long tradition in this area, and it has ties to semantics and classical philosophy. The Google self-driving car people are working on higher-level understanding out of necessity. They need to not just recognize other road users, but infer their intent and predict their behavior. They need "common sense" at an animal level. This may be more important than language. Most of the mammals have that level of common sense, enough to deal with their environment, and they do it without much language. It makes sense to get that problem solved before dealing with language. At last, there's a "killer app" for this technology and big money is being spent solving it.
- theunixbeard 11y agoAn interesting article about the author, Gary Marcus, and his stealth startup[1]: https://www.technologyreview.com/s/544606/can-this-man-make-aimore-human/ https://www.technologyreview.com/s/544606/can-this-man-make-... [1] http://geometric.ai/ http://geometric.ai/
- vonnik 11y agoI'm a bit disappointed in this piece. It doesn't say anything surprising to anyone who read a few words into the DeepMind paper, and it serves to settle some of Marcus's academic scores: > two people ought to be really pleased by this result: Steven Pinker, and myself. Pinker and I spent the 1990’s lobbying — against enormous hostility from the field — for hybrid systems Told-you-so's are almost always boring, especially when they are part of a larger campaign. Here, Marcus's campaign is that neural nets are not enough, which isn't really news to DeepMind or most other people working with NNs, and doesn't matter much to anyone not working with them. His chief critique is their interpretability. >In 2016 networks have gotten deeper and deeper, but there are still very few provable guarantees about how they work with real-world data. But for most of the world, including the people using whatever Marcus's startup eventually makes, predictive accuracy trumps interpretability. Let's get to 99% accuracy and worry about why later. And that's what researchers have done for many problems with NNs. Of course it's nice to know why, but it's not a fatal flaw if you don't, most of the time. IBM's struggles to market Watson are a bit of a straw man. If you had judged the PC market by IBM's moves a few decades ago, you might have reached the same conclusions, and you would have been dead wrong.
- eli_gottlieb 11y ago>But for most of the world, including the people using whatever Marcus's startup eventually makes, predictive accuracy trumps interpretability. Does it? What if the network has 99% accuracy, but is equally confident about its correct and incorrect predictions? "Deep neural networks are easily fooled", after all.
- vonnik 11y agoSure, that's a flaw. It's just not a fatal flaw. For the chief reason that there's probably nothing better. So you take your lumps and remember that it's wrong sometimes. It's something we can work on while still benefitting from these tools.
- eli_gottlieb 11y ago>For the chief reason that there's probably nothing better. The paper "Deep Neural Networks are Easily Fooled" noted that generative models don't suffer from this flaw.
- arthur_pryor 11y agoit seems to me that while humans are built out of neural nets, we are capable of logic, and the sort of reasoning that seems to be fall under the category of "tree search" in this conversation. in that sense, it would seem that we can do deductive logical reasoning, and we run that software on neural net hardware (slash firmware/software). so, why the slavishness among some to neural nets and building everything on top of that? why emulate logic processing on top of associative processing and then mesh the two, when you could just do associative processing and mesh it with more "native" logic processing, since man-made computing hardware already does that easily? also: this has been brought up here and elsewhere before, but as the article mentions: "Just yesterday, a few hours before the Go paper was made public, I went to a talk where a graduate student of a deep learning expert acknowledged that (a) people in that field still don’t really understand why their models work as they well as they do and (b) they still can’t really guarantee much of anything if you test them in circumstances that differ significantly from the circumstances on which they were trained. To many neural network people, Minsky represents the evil empire. But almost half a century later they still haven’t fully faced up to his challenges." let's keep in mind that some of the biggest mistakes humans make come from unexamined associative reasoning. let's also keep in mind that this crowd tends to be particularly suspect of the sort of not-strictly-logical associative heuristics that we associate (haha) with more mainstream society (unexamined articles of faith, habits and social customs that have unintended deleterious effects, etc). one of my favorite failures of loose associative reasoning is racism, so here's a link many of you have probably seen, but it's an important thing to keep in mind, so here it is anyway: http://www.nytimes.com/2015/07/10/upshot/when-algorithms-discriminate.html?abt=0002&abg=1 http://www.nytimes.com/2015/07/10/upshot/when-algorithms-dis... let's not reproduce some of our species' biggest flaws just because it let us expediently reach some narrowly defined (and likely immediately financially desirable) goal. i realized i've sort of conflated my points here: it is entirely possible to implement all sorts of terrible things (like racism) using logic. there's certainly no shortage of spurious logic to justify all sorts of bad behavior. axioms need to be sound and nuance needs to be considered. but i think my general point is that humans aren't some sort of model of perfection, and should not be copied as such.
- MrQuincle 11y agoThe challenge is to have grammar-like and pointer-like structures in a connectionist network. To ground such symbolic notions is the entire quest!! MC tree search converges to minimax. I'm really fond of Bayesian methods, but I think arguments about optimality should not be overstated. The brain is just an approximation at best.
- mcv 11y agoInteresting. I studied AI in the 1990s, and although I don't know this author, I've always felt that the real progress in AI would come from combining various techniques. I don't understand why there would be any hostility towards that idea. (Except that in research people can be very protective of their own pet projects.)