3 ms·
> The computations required for deep learning research have been doubling every few months I feel this is misleading. Computation is cheap, so the computation
by taneq 7y ago
> The computations required for deep learning research have been doubling every few months
I feel this is misleading. Computation is cheap, so the computation thrown at deep learning research has been doubling every few months, but that doesn't mean it's required to do research (unless your research is "throw huge datasets at a neural net architecture and see if it sticks".)
- atoav 7y agoI understood it as “computation required to replicate stuff outlined in a paper has doubled” not as “we do more research so we do more computation”.
- mattkrause 7y agoThat...does seem to be a lot of the current research though.