3 ms·
Analog computers can't easily be mutliplexed and the integration density of memory + other compute is nowhere near as high as current SRAM/DRAM. This might chan
by orbifold 5y ago
Analog computers can't easily be mutliplexed and the integration density of memory + other compute is nowhere near as high as current SRAM/DRAM. This might change with memristive crossbars, but that still doesn't solve the structural part of the problem, since most deep learning workloads are nowadays structurally very far from a feed-forward perceptron and dynamic execution etc. are absent from analog approaches.
- visarga 5y agoModern architectures are becoming simpler, usually just stacks of transformers, and they are good for text, vision, audio, or almost any task without special modifications. That means if they could implement an optical transformer that is 100x more efficient/faster everyone will want to have it.