3 ms·
After reading halfway through Kurzweil's new book How to Create a Mind and getting all of the detailed explanations of hierarchical hidden Markov models and why
by ilaksh 14y ago
After reading halfway through Kurzweil's new book How to Create a Mind and getting all of the detailed explanations of hierarchical hidden Markov models and why they are better than neural nets, I am surprised to see so much news about neural nets.
How do Spaun's neural nets compare with the type of HHMMs in Kurzweil's book (in terms of capability)?
- pdog 14y agoI'd put Kurzweil's book down and pick up some more recent research. As the biologist P.Z. Myers once wrote, “Ray Kurzweil is a genius. One of the greatest hucksters of the age.” The full New Yorker article, Ray Kurzweil's Dubious New Theory of Mind[1], makes me question how relevant he is today. [1] - http://www.newyorker.com/online/blogs/books/2012/11/ray-kurzweils-dubious-new-theory-of-mind.html http://www.newyorker.com/online/blogs/books/2012/11/ray-kurz...
- ilaksh 14y agoI think that psychologist who didn't like the book didn't really understand the book. I also don't think that P.Z. Meyers ever understood much of what Kurzweil was talking about either. My guess is that maybe some of the more biologically accurate spiking neural network simulations are more capable than the more typical neural nets that Kurzweil dismisses, but also less efficient than hierarchical hidden Markov models. When I Google hierarchical hidden Markov models I see it being used in quite a lot of current research. I also see neural nets being mentioned, sometimes in the same project. What research would you recommend?
- rpm4321 14y agoHey pdog this isn't really in response to you - it's more something that's been bothering me for awhile - but who the hell appointed Gary Marcus the arbiter of all things AI? The New Yorker apparently hired this guy to be an AI columnist, and he has no background in either neuroscience or computer science, only psychology. If you read his articles, he veers wildly from "strong AI ain't gonna happen" to "AI could destroy us all", the only common thread being pessimism. Meanwhile, he displays a frightening lack of understanding of the subject matter, and perhaps most disturbingly, in some of his more alarmist articles advocates that computer scientists should step aside and make room for psychologists, philosophers, lawyers, and politicians to sort out these thorny issues at the big boy table. Kurzweil is certainly fair game for legitimate criticism, but Marcus calling Kurzweil a joke is an even big joke in itself.
- ma2rten 14y agoI didn't read the book in question, nor do I know much about HHMMs. Could you summarize the argument? However, I will still try to answer your question. First, note that most of the stuff you read on HN about NNs is about practical applications. Resent research in NNs has lead to good results on hard problems, such as object and speech recognition. Nobody is claiming that these types of neural works are actually a good (low-level) model for how the brain works, they just give empirically good results on some tasks. If you aim is making a model for how the brain works, note that all models are just that: models. Different models can be good at modeling different aspects of how the brain works.