3 ms·

There is a very quick reference to the person who inspired him, Jeff Hawkins, whose book is worth a read: http://www.amazon.com/On-Intelligence-Jeff-Hawkins/dp

There is a very quick reference to the person who inspired him, Jeff Hawkins, whose book is worth a read: http://www.amazon.com/On-Intelligence-Jeff-Hawkins/dp/0805078533/ http://www.amazon.com/On-Intelligence-Jeff-Hawkins/dp/080507... Edit: update link

netrus 13y ago
Link does not load CSS for me, but this does: http://www.amazon.com/Intelligence-Jeff-Hawkins/dp/B000GQLCVE http://www.amazon.com/Intelligence-Jeff-Hawkins/dp/B000GQLCV...
- kinofcain 13y ago
  Thanks, had stripped the tracking codes off the mobile link, but it doesn't load right on desktop.
blhack 13y ago
That book will change the way that you look at yourself.
lomendil 13y ago
I just saw Jeff Hawkins give a talk and it was quite interesting. I was a bit worried, however, that he is basing his theory of intelligence on the human neocortex, while claiming to go after general principles. This is guaranteed not to be terribly general, considering the many bits of matter on this planet that exhibit intelligence without a neocortex. By many, I mean ones that hugely outnumber humans. So very interesting stuff, but not the answer that I think he wants it to be.
- Lambdanaut 13y ago
  In "On Intelligence" he postulates that he's not necessarily going for a "human-like" intelligence or even a "life-like" one. Basically he just wants something that's very good at recognizing patterns over time, which I can imagine the neocortex would be great at. Though, he also references the thalamus and hippocampus in the books a lot, as very important parts of the brain to his framework. [http://en.wikipedia.org/wiki/Memory-prediction_framework#Neurophysiological_implementation http://en.wikipedia.org/wiki/Memory-prediction_framework#Neu...]
thomaspaine 13y ago
Grok (formerly Numenta) has a slightly more technical white paper that goes into more detail on the actual algorithms from On Intelligence: https://www.groksolutions.com/htm-overview/education/HTM_CorticalLearningAlgorithms.pdf https://www.groksolutions.com/htm-overview/education/HTM_Cor... There are some subtle differences between HTMs and straight up deep learning, mainly the requirement for HTM data to be temporal and spatial. I know Andrew used to sit on an advisory committee at Numenta, I don't know if he still does.

netrus 13y ago

Link does not load CSS for me, but this does: http://www.amazon.com/Intelligence-Jeff-Hawkins/dp/B000GQLCVE http://www.amazon.com/Intelligence-Jeff-Hawkins/dp/B000GQLCV...

kinofcain 13y ago
Thanks, had stripped the tracking codes off the mobile link, but it doesn't load right on desktop.

blhack 13y ago

That book will change the way that you look at yourself.

lomendil 13y ago

I just saw Jeff Hawkins give a talk and it was quite interesting. I was a bit worried, however, that he is basing his theory of intelligence on the human neocortex, while claiming to go after general principles. This is guaranteed not to be terribly general, considering the many bits of matter on this planet that exhibit intelligence without a neocortex. By many, I mean ones that hugely outnumber humans. So very interesting stuff, but not the answer that I think he wants it to be.

Lambdanaut 13y ago
In "On Intelligence" he postulates that he's not necessarily going for a "human-like" intelligence or even a "life-like" one. Basically he just wants something that's very good at recognizing patterns over time, which I can imagine the neocortex would be great at. Though, he also references the thalamus and hippocampus in the books a lot, as very important parts of the brain to his framework. [http://en.wikipedia.org/wiki/Memory-prediction_framework#Neurophysiological_implementation http://en.wikipedia.org/wiki/Memory-prediction_framework#Neu...]

thomaspaine 13y ago

Grok (formerly Numenta) has a slightly more technical white paper that goes into more detail on the actual algorithms from On Intelligence: https://www.groksolutions.com/htm-overview/education/HTM_CorticalLearningAlgorithms.pdf https://www.groksolutions.com/htm-overview/education/HTM_Cor... There are some subtle differences between HTMs and straight up deep learning, mainly the requirement for HTM data to be temporal and spatial. I know Andrew used to sit on an advisory committee at Numenta, I don't know if he still does.