4 ms·
Sounds like Numenta's HTM algorithm. What are the differences?
by teabee89 10y ago
Sounds like Numenta's HTM algorithm. What are the differences?
- AstralStorm 10y agoNumenta algorithm is not online learning. It does process and learn streaming data, but internally batches it into phases, a process not shown to happen in the brain.
- oxtopus 10y agoFull disclosure: I work at Numenta. In the HTM model (presumably the Numenta algorithm you're referring to), synaptic weights are updated with every new data point in discrete time steps (as opposed to continuous). In that sense, HTM is an online learning model. There was an experimental implementation of Temporal Memory (one component in HTM) that batched up some of those operations into phases, but that still happened in a single time step and that implementation has since been phased out (pardon the pun). For some additional literature on the topic, see: - "Why Neurons Have Thousands of Synapses, a Theory of Sequence Memory in Neocortex", http://journal.frontiersin.org/article/10.3389/fncir.2016.00023/full http://journal.frontiersin.org/article/10.3389/fncir.2016.00... - "Continuous Online Sequence Learning with an Unsupervised Neural Network Model", http://www.mitpressjournals.org/doi/abs/10.1162/NECO_a_00893#.WCCsMmQrJBz http://www.mitpressjournals.org/doi/abs/10.1162/NECO_a_00893... - "The HTM Spatial Pooler: a neocortical algorithm for online sparse distributed coding", http://www.biorxiv.org/content/early/2016/11/02/085035.abstract?%3Fcollection= http://www.biorxiv.org/content/early/2016/11/02/085035.abstr...