3 ms·
Different words, same concept as sparse distributed representation in a hierarchical distribution of neural networks. Automating the process of learning is non
by robbedpeter 5y ago
Different words, same concept as sparse distributed representation in a hierarchical distribution of neural networks.
Automating the process of learning is non-trivial and making it efficient is an ongoing question.
Vicarious.ai , Hawkins Numenta, cortical.io and various other projects have been chasing this in various guises for many years.
The lottery ticket effect on very large networks can make contrasting different architectures difficult, and this looks suspect. IBM isn't necessarily a powerhouse in this arena, so it'd make sense not to get excited until they verify and expand their theory. It could be that their initial success is entirely coincidental with lotteries and the particulars of the design are a dead end.