6 ms·

My PhD program was in neuroinformatics and it exactly was this intersection, it was not an accurate comment. Hinton knows neurophysiology, its clear in any of h

My PhD program was in neuroinformatics and it exactly was this intersection, it was not an accurate comment. Hinton knows neurophysiology, its clear in any of his talks he reads about the weird illusions that give us insight into the computational mechanisms going on in the inside. (e.g. how we recognize rotated objects but with symmetry unresolved) http://en.wikipedia.org/wiki/Neuroinformatics http://en.wikipedia.org/wiki/Neuroinformatics

p1esk 12y ago
Computational mechanisms that Hinton uses in his ML models have very little to do with what is going on in brains. It's kind of like watching a bird fly and building a jet or a helicopter. Hawkins' comment was about building a machine that "flies like a bird" - actually looking at what's going on in real brains. Hinton seems to be inspired not by brain physiology or anatomy, but by psychology. What about you? Have you implemented in software any of the ideas you learned from looking at the brain? I mean, the software designed to perform some intelligent task?
- Teodolfo 12y ago
  Using your analogy I would guess Geoff Hinton's goal is to understand aerodynamics and which parts of bird flight are actually necessary for flight and which are simply accidents of evolution.
  - p1esk 12y ago
    Hinton does not really try to understand how brain does it. His latest ideas on capsules are a little bit closer to the brain anatomy, but still very far away from real brains. I think he admits that himself. Jeff Hawkins is the guy who actually tries to understand "which parts of bird flight are actually necessary for flight".
    - tlarkworthy 12y ago
      Hinton explicitly states he was intreiged that we can recognise an upside down R, but not whether its reflected, and made a neural model that leveraged the same weakness That indicates he reads psychophysics papers and he uses the same loosening of problem constraints in his visual recognition models. That is drawing on cross discipline insights. I don't care he doesn't model ion channels or fine grained neuroanatomy, he is inspired by the coarse grained computational tricks employed in biology. For a primarily AI researcher thats an ideal level of abstraction.
      - p1esk 12y ago
        He is looking at human behavior, sure. He is trying to copy some of the specifics of that behavior in his systems (like "pose" represented by columns of neurons. However, it still seems that he treats human brain as a black box, and he's not trying to understand the mechanisms of computation and information processing in the real brains - and I'm not talking about low level stuff like ion channels, I'm talking things like prediction, anomaly detection, or knowledge representation. If you believe that the best way to build AI is to model human brain, then we need to look inside the brain, and Hinton does not do that. If you are interested in the intersection of neuroscience and AI, Jeff Hawkins' HTM theory is the best we got so far. Unfortunately, most people talking about it can't be bothered to actually learn it. Just read HTM white paper [1], and decide for yourself. [1] http://numenta.org/htm-white-paper.html http://numenta.org/htm-white-paper.html
        superobserver 12y ago
        I've read it. Just not a good enough programmer to implement it. Maybe in time that will change. It's really exciting; I just wish people with the requisite skills would try to understand it more fully.
        p1esk 12y ago
        You don't need to implement it. Numenta implemented the theory as an open source project called Nupic. You can contribute by running experiments.
    - deleted 12y ago
      [deleted]
- superobserver 12y ago
  This also reminds me of the attempt by a researcher to develop an AI to solve bongard problems. He apparently gave up for supposed ethical reasons: http://www.foundalis.com/soc/why_no_more_Bongard.html http://www.foundalis.com/soc/why_no_more_Bongard.html . I suspect other reasons (i.e., couldn't actually create a program that would do so), but it isn't altogether important what they are. I'd like to see a real AI solve such problems - and it's going to take understanding HI to do that.

p1esk 12y ago

Computational mechanisms that Hinton uses in his ML models have very little to do with what is going on in brains. It's kind of like watching a bird fly and building a jet or a helicopter. Hawkins' comment was about building a machine that "flies like a bird" - actually looking at what's going on in real brains. Hinton seems to be inspired not by brain physiology or anatomy, but by psychology. What about you? Have you implemented in software any of the ideas you learned from looking at the brain? I mean, the software designed to perform some intelligent task?

Teodolfo 12y ago
Using your analogy I would guess Geoff Hinton's goal is to understand aerodynamics and which parts of bird flight are actually necessary for flight and which are simply accidents of evolution.
- p1esk 12y ago
  Hinton does not really try to understand how brain does it. His latest ideas on capsules are a little bit closer to the brain anatomy, but still very far away from real brains. I think he admits that himself. Jeff Hawkins is the guy who actually tries to understand "which parts of bird flight are actually necessary for flight".
  - tlarkworthy 12y ago
    Hinton explicitly states he was intreiged that we can recognise an upside down R, but not whether its reflected, and made a neural model that leveraged the same weakness That indicates he reads psychophysics papers and he uses the same loosening of problem constraints in his visual recognition models. That is drawing on cross discipline insights. I don't care he doesn't model ion channels or fine grained neuroanatomy, he is inspired by the coarse grained computational tricks employed in biology. For a primarily AI researcher thats an ideal level of abstraction.
    - p1esk 12y ago
      He is looking at human behavior, sure. He is trying to copy some of the specifics of that behavior in his systems (like "pose" represented by columns of neurons. However, it still seems that he treats human brain as a black box, and he's not trying to understand the mechanisms of computation and information processing in the real brains - and I'm not talking about low level stuff like ion channels, I'm talking things like prediction, anomaly detection, or knowledge representation. If you believe that the best way to build AI is to model human brain, then we need to look inside the brain, and Hinton does not do that. If you are interested in the intersection of neuroscience and AI, Jeff Hawkins' HTM theory is the best we got so far. Unfortunately, most people talking about it can't be bothered to actually learn it. Just read HTM white paper [1], and decide for yourself. [1] http://numenta.org/htm-white-paper.html http://numenta.org/htm-white-paper.html
      - superobserver 12y ago
        I've read it. Just not a good enough programmer to implement it. Maybe in time that will change. It's really exciting; I just wish people with the requisite skills would try to understand it more fully.
        p1esk 12y ago
        You don't need to implement it. Numenta implemented the theory as an open source project called Nupic. You can contribute by running experiments.
  - deleted 12y ago
    [deleted]
superobserver 12y ago
This also reminds me of the attempt by a researcher to develop an AI to solve bongard problems. He apparently gave up for supposed ethical reasons: http://www.foundalis.com/soc/why_no_more_Bongard.html http://www.foundalis.com/soc/why_no_more_Bongard.html . I suspect other reasons (i.e., couldn't actually create a program that would do so), but it isn't altogether important what they are. I'd like to see a real AI solve such problems - and it's going to take understanding HI to do that.