4 ms·
I speculate that the eventual ideal goal to strive towards will be RAM strip-to-strip processing taking all of one module's data, feeding one layer and dumping
by loa_in_ 6y ago
I speculate that the eventual ideal goal to strive towards will be RAM strip-to-strip processing taking all of one module's data, feeding one layer and dumping results into the next module. The individual layers accessible for both read and write as ordinary RAM.
- plutonorm 6y agoThis is a great step and all, but shouldn't we be being a little more adventurous? A unified understanding of computation and thermodynamics has the potential to enable systems that are vastly more capable. We are piddling around in the shallow end making incremental improvements. A few billion thrown in novel directions could reap extraordinary rewards. https://arxiv.org/abs/1911.01968 https://arxiv.org/abs/1911.01968
- loa_in_ 6y agoI understand where are you're coming from, but I would rather see modular and stackable pieces affordable by ordinary users and hackable for power users. Hackable mainly because of the nature of neural networks - their architecture matters. > Vastly more capable systems I interpret this as specialized silicon that's mass produced? I urge you to remember how much academics and hobbyists gain from having FPGAs around, despite their relative bulkiness and mediocre parameters.