10 ms·
The Man Who Would Teach Machines to Think
- nathansnyder 13y agoLove'd this quote "...the trillion-dollar question: Will the approach undergirding AI today—an approach that borrows little from the mind, that’s grounded instead in big data and big engineering—get us to where we want to go? How do you make a search engine that understands if you don’t know how you understand?...AI has become too much like the man who tries to get to the moon by climbing a tree: "One can report steady progress, all the way to the top of the tree.”"
- jonbaer 13y agoSurprised no mention of the Chinese Room in this article ...
- tunesmith 13y agoMe too. I wonder what Hofstadter's responses to it is. Edit: Googling, it seems that Hofstadter's response is along the lines of Haugeland. That by describing the translator as a man, we are improperly being asked to identify with him, when in the actual metaphor, the man is only an implementer in a larger system. The larger system actually does understand Chinese. So the claim is that the Chinese Room thought exercise is actually a fallacy.
- breadbox 13y agoIn my completely unhumble opinion, that's like expecting a mention of geocentrism in every article about NASA. Hofstadter provides a detailed response to the Chinese Room thought-experiement in "Le Ton Beau de Marot".
- stiff 13y agoThis is a bad article, especially for a technical audience. It romanticizes things a lot, as journalists have to, to keep up the readership rates, but it doesn't make for a very balanced judgement. This kind of debate is going on and on, you can read a much more reasonable account here: http://norvig.com/chomsky.html http://norvig.com/chomsky.html I find the analogy to Einstein at the end of article especially funny. I think it's much more likely that people will look upon current defenders of "good old fashioned AI" like they now do upon people who still looked for ether after Einstein's discoveries.
- breckinloggins 13y agoI wouldn't call the article "bad", but I do think it loses points for furthering a "feud" which just need not exist. Norvig-style AI is incredibly useful in the here and now to solve real-world problems. Hofstadter-style AI is driven by a deep desire to exorcize one of the few remaining "ghosts" in our otherwise natural world. It is an attempt to REMOVE the "ether" of thought stuff, not to hide in it. Perhaps a terminology change is in order? I would call what people like Norvig and Hinton and Ng do "machine learning", while I would probably use "artificial sentience" to describe the Hofstadter-Dennet camp, as that seems to more closely capture their ultimate goal. The world needs both approaches, and hopefully the time will come when the gap is bridged.
- upquark 13y ago100% agreed. GEB is a great book, but Hofstadter hasn't been relevant in this field for a while now (AFAIK). Good old fashioned AI approaches show what a giant blind spot our minds are for our species, how little introspection goes on even within the brightest minds. Modern approaches to AI/ML have yielded tangible results and moved the field in the right direction, dismissing those results makes anyone look ridiculous in 2013.
- Daniel_Newby 13y agoPure ML approaches are doomed to end up in a tar pit of AI mysticism. A statistical learning model can and will conclude that the thunder gods make the crops grow. People like Douglas Hofstadter and Eliezer Yudkowsky will have to use classical AI approaches to train our AI children in science and rationality.
- aethertap 13y agoI've been enjoying this series from MIT OCW on Gödel, Escher, Bach: http://ocw.mit.edu/high-school/humanities-and-social-sciences/godel-escher-bach/video-lectures/ http://ocw.mit.edu/high-school/humanities-and-social-science...
- fsckin 13y agoMe too.
- drcode 13y agoDouglas Hofstadter is important because most AI work right now focuses either on (1) big-data-style statistical analysis or (2) emulating brain anatomy. DH is the most well known guy of a small, stubborn group of AI developers who still believe that "human thought" can be reasoned about and can be understood in isolation, and that we can build intelligence without simply reducing it to statistics or to brain anatomy. I applaud his efforts, and find some of the programs he's written both creative and refreshing.
- RogerL 13y agoI'm nobody compared to the quoted people, but I use AI in computer vision, and while I love using Bayesian math for parts of it, I've found no substitute for pragmatically programming in knowledge about the system. Which is different from what the article is talking about; I'm aware. I'm just trying to make a system that works, not understand how the brain works. But I view those as somewhat orthogonal problems ; my computer is structured differently than a human brain, perhaps my algorithms should be different as well. Certainly I see no reason to view the brain as having the best algorithm - perhaps a very non-human brain type of algorithm would be superior. Evolution worked with what it had, and it is unlikely that the result is optimal.
- jostmey 13y agoI think you are absolutely right. Evolution selected for a form of intelligence that was highly calibrated and biased for operating in the wilderness of Nature. Our minds are not necessary correctly geared for abstract thinking, logic, and rational thought.
- joshuaeckroth 13y agoMembers of what you might call that "stubborn group" have started a yearly conference: Advances in Cognitive Systems. See the top of their FAQ: http://cogsys.org/faq http://cogsys.org/faq
- joe_the_user 13y agoNice group but they are definitely swimming against the currently standard approach. That said, I think one really interest article here is: "Human-Level Artificial Intelligence Must Be an Extraordinary Science" by Nicholas L. Cassimatis Brings a lot of challenges into focus. http://www.cogsys.org/pdf/paper-1-5.pdf http://www.cogsys.org/pdf/paper-1-5.pdf www.cogsys.org
- cs702 13y ago"Gödel, Escher, Bach" is one of my favorite books, and I have a tremendous amount of respect and admiration for Hofstadter... so I'm really disappointed and saddened to read that he (quoting from the article) "hasn't been to an artificial-intelligence conference in 30 years. 'There's no communication between me and these people,' he says of his AI peers. 'None. Zero. I don't want to talk to colleagues that I find very, very intransigent and hard to convince of anything. You know, I call them colleagues, but they’re almost not colleagues -- we can't speak to each other.'" Hofstadter should be COLLABORATING with all those other researchers who are working with statistical methods, emulating biology, and/or pursuing other approaches! He should be looking at approaches like Geoff Hinton's deep belief networks and brain-inspired systems like Jeff Hawkins's NuPIC, and comparing and contrasting them with his own theories and findings! The converse is true too: all those other researchers should be finding ways to collaborate with Hofstadter. It could very well be that a NEW SYNTHESIS of all these different approaches will be necessary for us to understand how complex, multi-layered models consisting of a very large number of 'mindless' components ultimately produce what we call "intelligence." All these different approaches to research are -- or at least should be -- complementary.
- oskarth 13y agoI think you are making a mistake in assuming that you know how another person, who presumably is much more qualified at this specific domain, should spend their time to be the most productive in that domain. That's kind of like telling Elon Musk that he should definitely use GTD - and if he doesn't he's doing something wrong - cause he'd be so much more productive. It is an interesting question why he doesn't want to collaborate with other people, but he is far from alone in that m.o. and he kind of answered it.
- ttt_ 13y agoI agree. While reading the article I can't help but, sort of, empathize with modern AI programs. Me and Watson are very similar, Watson can win Jeopardy but has no understanding why, I can recognize a handwritten 'a' and I too have no understanding why. When I look at my daughter developing, from baby to infant to child. Hasn't that been a constant, intensive training? As she recognizes stuff, I give feedback. After a while she starts correlating stuff, and signals for me to give feedback. By the time she's an adult, she will have full control of her intelligence, but also no understanding. Maybe what we are missing is just the algorithm for information storage and retrieval. If we can master Genetic Algorithms, why not Celular Databases? Or Chemical Procedures?
- ssivark 13y agoNorvig and co. are like drunk men searching for their lost key under a streetlight. It might not be where it lies, but that's the only place where they think think could find something, or at least make some tangible progress. Hofstadter doesn't mind taking the long shot... feeling his way about in the dark, in the hope of inching forward and making progress towards artificial intelligence. This comparison between complementary approaches is an apt analogy for most fields, where the focus shifts every once in a while, when one of the approaches largely hits a wall and most people switch to the other one. A while later, the trends will almost inevitably reverse and draw inspiration from other approaches. The unfortunate thing is that there's no dialogue between the two camps, which makes it that much harder to port good ideas from one context to the other. I could provide examples from physics research, or for that matter, trends in static-vs-dynamic blogs :P Also, the more "applied" the field, the shorter these cycles are. Ref: https://en.wikipedia.org/wiki/Streetlight_effect https://en.wikipedia.org/wiki/Streetlight_effect
- stiff 13y agoHofstadter is about as much of a science researcher as Goethe was in his day.
- duwease 13y agoConsidering the large and growing bank of research that highlights areas where the brain's output is flawed or plain wrong when compared to the consensus "optimal solution", I think I'm with the "AI establishment" as it's painted by this article. It doesn't seem self-evident to me that the inner workings of the human mind are the only or even optimal implementation of intelligence for every task. If anything, the human mind seems to me to be a particular algorithm that is flexible, but trades that flexibility for capability in certain problem areas. Using a transportation metaphor, it's like walking versus air travel. Walking is incredibly flexible when it comes to where you can go, but air travel is by far the optimal route to get from coast-to-coast, although you are limited to travelling between airstrips. I feel like focusing on the human brain as the "true" intelligence is like claiming that walking is the only true transportation, instead of focusing on optimal routes for each problem.
- hharrison 13y agoMaybe the article doesn't get it across, but the anti-establishment crowd doesn't think that doing things the "human way" is always the best solution. In fact, they acknowledge that it's often, even usually, not. Hofstadter does not want to replace (e.g.) GPS AI with human-style intelligence, or even more ridiculous, replace the AI that flies airplanes with one that gets bored and does crossword puzzles instead of paying attention. Instead he wants to understand human-style intelligence because that opens doors to tacking really interesting scientific/philosophical problems like personality, self, consciousness, autonomy, etc. In short, the camps have different goals. One is trying to solve problems optimally. The other is trying to understand what intelligence means, biologically. AI as a sub-discipline of Engineering, vs. AI as a sub-discipline of Cognitive Science, perhaps.
- csense 13y ago> replace the AI that flies airplanes with one that gets bored and does crossword puzzles This would be a great scenario for a sci-fi novel / movie. An AI that threatens the human race not by achieving sentience and attempting world domination, but by achieving sentience and playing Sudoku instead of doing its job...
- atlanticus 13y agoI think a big part of the problem with AI is you are trying to map a digital model onto an analog system. There was a story on HN last year, I can't seem to find, that used a genetic algorithm on analog circuits to evolve optimal pattern matching for certain images. The results were good but when they went to build another one it didn't work right because of unmeasured EM feedback and subtle differences between individual circuits meaning every circuit would have to run its own evolution, negating most of the usefulness of the project. Maybe an analog model would be more appropriate.
- stiff 13y agoSo Good Old Fashioned AI[1] is the new hot underdog AI thing now? I seriously don't understand the praise of Hostadter in the article and in the comments here, and the criticism of the mainstream AI research, especially it is very hard to find any precise details of what he does and what are the outcomes. There have been attempts to understand intelligence with intelligence (logic, symbols, reasoning etc.) for 30 years, to not much effect, now AI and machine learning are advancing quite steadily, so why the snark? All evidence suggests that the way the brain itself learns things is statistical and probabilistic in nature. There are also new disciplines now, like Probabilistic Graphical Models, which are free of some of the traditional downsides of purely statistical methods, in that they can be interpreted and that human-understandable knowledge can be extracted from them. This is something that really seems promising, and to some extent is an union of the old and new approaches, despite the claims of a big division, but it is hard to see much premise in purely symbolic methods invented merely by some guy somewhere thinking very hard. I for one am very happy that people seek inspiration in the way human brain works, that's what science is, if you just come up with things without consulting the real world it's not science, it's philosophy, the one discipline that has yet to produce a single result. [1] http://en.wikipedia.org/wiki/GOFAI http://en.wikipedia.org/wiki/GOFAI
- hharrison 13y agoThere are more divisions than the article can get into, of course. I think the main one is between AI to solve engineering problems and AI to better understand the mind. The article is about doing the latter when everyone else's definition of AI is the former. What you're talking about, I think, is various approaches within the latter group of researchers. I defended Hofstadter in another reply because I find his goals worthwhile in and of themselves - in a "basic research" sense. Discarding anything that's not an optimal solution - the attitude taken by a couple of responses here - ignores a whole lot of interesting science, and as a scientist it bothers me quite a bit. That said, once we're talking about the goal of understanding the human mind, GOFAI is, to be sure, incredibly old-fashioned, and you won't find me defending Hofstadter anymore as far as his approach. His goal is a worthwhile one, but you're right that his approach shouldn't really be considered an 'underdog'. Personally, I think the best hope for understanding what intelligence is, in a general sense, comes from non-equilibrium thermodynamics, as in the sort of research goin on here: http://www.tandfonline.com/toc/heco20/24/1#.UmlRN_mfihM http://www.tandfonline.com/toc/heco20/24/1#.UmlRN_mfihM but that's a can of worms for another post. As an aside, regarding your last comment, I completely disagree on your view of philsoophy. It may not have produced results but it has guided science. But I agree with the thrust of your sentiment: an AI researcher with the goal of understanding the human mind should be spending as much time studying humans (as in, doing Psych or Cognitive Science experiments) as programming AIs.
- deleted 13y ago[deleted]
- sinkasapa 13y agoI really enjoyed this talk of his on analogy in human language. https://www.youtube.com/watch?v=n8m7lFQ3njk https://www.youtube.com/watch?v=n8m7lFQ3njk
- ArbitraryLimits 13y agoIt's interesting to see this article portray Hofstadter as the last of the dying breed of GOFAI researchers. When I was in college (and GOFAI was still alive) GOFAI researchers themselves portrayed him as very much an outsider.
- cjbprime 13y agoThis is the article referenced as pending publication in http://www.aeonmagazine.com/living-together/james-somers-web-developer-money/ http://www.aeonmagazine.com/living-together/james-somers-web..., which is incidentally my favorite article about startups.
- 9wymanm 13y agoThe father of psychology, William James I was under the impression that Wilhelm Wundt was the father of psychology.
- hharrison 13y agoWell you might say Wundt was the father of structuralism and James the father of functionalism - a deep divide which is still felt today. I suppose this shows the author's bias, implicit or not.
- jmilloy 13y agoI'm not convinced that Hofstadter is pursuing computers that think like humans, so much as computers that appear to think like humans. He abstracts certain observable behaviors of the human mind (e.g. analogy), but there's no guarantee that what a brain can observe about itself is what a brain is actually doing. Does it make sense to ignore the underlying behavior of human brains, and instead try to directly emulate a particular abstraction? We can't let our romantic notions of what brains "do" get in the way.
- hharrison 13y agoI agree with your point, but the solution isn't to instead model the underlying biological nuts and bolts (assuming this is what you mean by "underlying behavior of human brains"). Even if those approaches approximated human behavior (which they don't), it wouldn't be all that informative. Just as creating "artificial" intelligence by growing a brain in a petri dish wouldn't be informative either. (Well, it wouldn't be informative as to what the brain's job description is, although we could presumably learn plenty from of other things from the exercise). The better solution is to come up with creative experiments (with human experiments) that can arbitrate between competing implementations. With modern technologies like virtual reality, you can create almost any counterfactual situation and that to decide between theories that make the same predictions "in the real world".
- deleted 13y ago[deleted]
- deleted 13y ago[deleted]
- dnautics 13y agoWhen you read Fluid Concepts and Creative Analogies: Computer Models of the Fundamental Mechanisms of Thought, which describes in detail this architecture and the logic and mechanics of the programs that use it, you wonder whether maybe Hofstadter got famous for the wrong book. I cannot recommend "Creative Analogies" more. I have purchased no less than four copies (two for myself; two for others, including K. Barry Sharpless, who once made a remark about AI that was reminiscent of some of the ideas in CA) over the years. It's even better than "Surfaces".
- MichaelMoser123 13y agoAlso of interest: Hofstadters lecture about analogy on youtube http://www.youtube.com/watch?v=n8m7lFQ3njk http://www.youtube.com/watch?v=n8m7lFQ3njk Also some earlier work on the subject http://citeseerx.ist.psu.edu/viewdoc/summary?doi=10.1.1.307.5740 http://citeseerx.ist.psu.edu/viewdoc/summary?doi=10.1.1.307.... http://citeseerx.ist.psu.edu/viewdoc/summary?doi=10.1.1.57.766 http://citeseerx.ist.psu.edu/viewdoc/summary?doi=10.1.1.57.7... I have also written a review on this very interesting book "Surfaces and Essences: Analogy as the Fuel and Fire of Thinking" http://mosermichael.github.io/cstuff/all/blogg/2013/10/15/post-1.html http://mosermichael.github.io/cstuff/all/blogg/2013/10/15/po...
- xerophtye 13y agoOk so here's an attempt to clear up the feud. As i see it, what Hofstadter wants is an anti-gravity elevator. The "Modern" (aka practical) AI approach is ladders, stairs... and eventually mechanical elevators. Now ofcouse, progress along the "practical" approach will NEVER lead to an anti-gravity elevator, as the fundamental principles are completely different. But they get the job done. See, that's the point, as incredibly awesome and useful as the anti-gravity elevator might be, mankind can't wait around for someone to invent it, just raise stuff, or travel in the vertical dimension. And hence all our modern AI systems (including google, siri, robots, warehouse management systems, etc etc) are powered by this approach. So should we scrap stairs an elevators in pursuit of anti-gravity? Certainly not, we NEED them right NOW. But does this mean we should dreaming about, and working towards anti-gravity? HELL NO!! We need that too. And hence, as much as i LOVE Hofstadter (i have had the same approach to AI ever since i was a kid), i still have a very PROFOUND respect for modern approaches because they help me create some functionally amazing software.
- mempko 13y agoThe saddest bit of all of this is that global warming will derail any AI future breakthrough