3 ms·
Backprop is expensive. Not sure what the revolutionary aspect is here. Smells a bit like the Theranos of AI.
by qeternity 10y ago
Backprop is expensive. Not sure what the revolutionary aspect is here. Smells a bit like the Theranos of AI.
- hidden-markov 10y agoI am pretty sure this is about optimizing the graphs of trained models. That is, training is not freed from "the prison of supercomputers".
- qeternity 10y agoExactly my point. Feed forward can run on much lower specs just fine. So their whole "prison of supercomputers" analogy is for the wrong side of the equation.
- deleted 10y ago[deleted]
- deleted 10y ago[deleted]
- emcq 10y agoThis is for optimizing inference. For consumer devices such as smart cameras, speech recognition on your phone, or robotics that's the part that matters. They have real speed improvements by using 1-bit quantitzed weights and then running operations using 32-bit or 64-bit bitfields which happen to use very few instructions/cycles on modern CPUS: https://github.com/allenai/XNOR-Net https://github.com/allenai/XNOR-Net