4 ms·
These HDVs (hyperdimensional binary vectors) sound a lot like the SDRs (sparse distributed representations) that Numenta talks about with their HTMs (hierarchic
by taneq 8y ago
These HDVs (hyperdimensional binary vectors) sound a lot like the SDRs (sparse distributed representations) that Numenta talks about with their HTMs (hierarchical temporal memory).
Wow, what a lot of TLAs.
- andbberger 8y agoThat is probably not a coincidence. Pentti Kanerva, who does a lot of work on hyperdimensional computing, is at the redwood center for theory neuro which Hawkins (numenta) helped found.
- evgen 8y agoKanerva is also the author of the (vastly underrated IMHO) book Sparse Distributed Memory from the late 80s that set the stage for a lot of this and predates Numenta by a couple of decades...
- taneq 8y agoHuh, thanks for the reference. I have heard elsewhere that the one issue with Numenta's work is that they aren't particularly proactive about citing prior art, so it's hard to know (as a newcomer) what parts are their innovations and what parts are incremental improvements on existing techniques.