6 ms·
This seems to be article that gives more information: A Theory of How Columns in the Neocortex Enable Learning the Structure of the World: https://www.ncbi.nlm
by mushishi 8y ago
This seems to be article that gives more information:
A Theory of How Columns in the Neocortex Enable Learning the Structure of the World:
https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5661005/ https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5661005/
Excerpt:
A simple thought experiment may be useful to understand our model. Imagine you reach your hand into a black box and try to determine what object is in the box, say a coffee cup. Using only one finger it is unlikely you could identify the object with a single touch. However, after making one contact with the cup, you move your finger and touch another location, and then another. After a few touches, you identify the object as a coffee cup. Recognizing the cup requires more than just the tactile sensation from the finger, the brain must also integrate knowledge of how the finger is moving, and hence where it is relative to the cup. Once you recognize the cup, each additional movement of the finger generates a prediction of where the finger will be on the cup after the movement, and what the finger will feel when it arrives at the new location. This is the first problem we wanted to address, how a small sensory array (e.g., the tip of a finger) can learn a predictive model of three dimensional objects by integrating sensation and movement-derived location information.
- Cixelyn 8y agoI think the paper that the NYT article is referencing is actually this one, published yesterday: A Framework for Intelligence and Cortical Function Based on Grid Cells in the Neocortex https://www.biorxiv.org/content/early/2018/10/13/442418 https://www.biorxiv.org/content/early/2018/10/13/442418 Jeff Hawkins is scheduled to give a talk at the Human Brain Project Open Day[1] in Maastricht, NL about this paper. The one linked in the parent is from last year, related to the mentioned story of him running his finger across the coffee cup. [1]: https://www.hbpopendaysummit-2018.org/programme/keynote-speakers https://www.hbpopendaysummit-2018.org/programme/keynote-spea...
- mirceal 8y agothanks. direct link to pdf: https://www.biorxiv.org/content/biorxiv/early/2018/10/13/442418.full.pdf https://www.biorxiv.org/content/biorxiv/early/2018/10/13/442...
- ilaksh 8y agoThis paper, which was inspired by Hawkins' work, is interesting to me: Feynman Machine: A Novel Neural Architecture for Cortical And Machine Intelligence https://www.aaai.org/ocs/index.php/SSS/SSS17/paper/download/15362/14605&ved=2ahUKEwjgl_Oj5obeAhV7HzQIHdjVDPgQFjABegQIBxAB&usg=AOvVaw2K1D6Saol_npPGbSlI4Alm https://www.aaai.org/ocs/index.php/SSS/SSS17/paper/download/... Details in the previous paper: https://arxiv.org/pdf/1609.03971 https://arxiv.org/pdf/1609.03971
- placebo 8y agoHis article on Medium [1] references this [2] [1] https://medium.com/@Numenta/the-secret-to-strong-ai-61d153e26273 https://medium.com/@Numenta/the-secret-to-strong-ai-61d153e2... [2] https://www.frontiersin.org/articles/10.3389/fncir.2017.00081/full https://www.frontiersin.org/articles/10.3389/fncir.2017.0008...
- ArtWomb 8y agoThis recent talk by Jeff Hawkins at Simons Foundation breaks it down quite well. And includes a live re-enactment of his coffee cup "epiphany" Does the Neocortex Use Grid Cell-Like Mechanisms to Learn the Structure of Objects? https://www.youtube.com/watch?v=zVGQeFFjhEk https://www.youtube.com/watch?v=zVGQeFFjhEk Russell Epstein also make a case for a predictive mechanism in "reorientation". Familiarizing ourselves to new physical locations may have an equivalence neurally and cognitively to the kind of "context-switch" that occurs when we switch from using one language to another. The Neurocognitive Basis of Spatial Reorientation https://www.cell.com/current-biology/fulltext/S0960-9822(18)30529-3 https://www.cell.com/current-biology/fulltext/S0960-9822(18)...
- emilfihlman 8y ago>This is the first problem we wanted to address, how a small sensory array (e.g., the tip of a finger) can learn a predictive model of three dimensional objects by integrating sensation and movement-derived location information. This doesn't follow from above but the idea of a pattern matching machine is certainly pretty great though I do see the parallels with FPGAs and how, even if the structure is the same, the function can be completely different and thus "understanding" the code running is a super hard problem and only in certain ways similar with all people.
- kuwze 8y agoI think that the visualization he used in the book was perfect. Imagine turning around and seeing an apple upon your desk. You would be surprised; and by that it shows the implicit modeling we do of our reality.
- sriku 8y agoQuite a few old thinkers have thought up models for that kind of prediction we do. Ex: Piaget. Gary Drescher's book "made up minds" presents his PhD work building a simulated environment and a robot in it that builds concepts about its environment through exploration.
- daganev 8y agoReminds me of the old mind palace tricks. Lots of mystic traditions rely on speaking about concepts as being close or far from each other in 3D space even when they have no physical representation. The idea that the columns main function is to relate things in space makes a lot of sense.