3 ms·
While the theoretical innovations have mostly been incremental, there has been a lot of progress in the development of "light" deep learning frameworks - so th
by mv4 7y ago
While the theoretical innovations have mostly been incremental, there has been a lot of progress in the development of "light" deep learning frameworks - so the tasks that previously required massive GPUs can now run on your phone. And this trend will continue.
- p1esk 7y agoLast I checked all those light frameworks still have to do good old matrix multiplications. What's changed?
- mv4 7y agoI see your point. Fundamentally, the same multiplications. However, if we look at TF Lite, for example - its internal operators were tuned for mobile devices, its new model file format is much more compact, and does not need to be parsed before usage. My point is - the hardware requirements aren't growing; instead, the frameworks are getting optimized to use less power.
- sanxiyn 7y agoThis seems targeted for training, not inference. It definitely seems to me compute need is growing for training. (Is TF Lite even relevant at all for training?)
- p1esk 7y agoI wish this was the case. 5 years ago I could train the most advanced, largest DL models in reasonable time (few weeks) on my 4 GPU workstation. Today something like GPT-2 would probably take years to train on 4 GPUs, despite the fact that GPUs I have now are 10 times faster than GPUs I had 5 years ago.