Where does the energy go in neural network workloads? Wires. To and from memory, in the memory dice, on the compute die, in the register files, etc. Check ou

Where does the energy go in neural network workloads? Wires. To and from memory, in the memory dice, on the compute die, in the register files, etc. Check out the paper "DNN Dataflow Choice is Overrated". And that's for the most compute bound cnns! Edit: and if you think there's enough SNR to make analog "deep" processing in memory work, go make a quick billion dollars by expanding commodity memory with multi level. If you can add another level to flash you'll get rich quick.