3 ms·
> That capability means either abandoning deep learning as inherently impossible to train small, or spending major resources to make it possible to train deep l
by gumby 9y ago
> That capability means either abandoning deep learning as inherently impossible to train small, or spending major resources to make it possible to train deep learning on small datasets with little compute.
> Is Google working on this problem? Is anyone?
Yes, but this is very much out of fashion at the moment (just as NNs were out of fashion for about three decades). Look at the work of Gary Marcus at NYU or Michael Whitbrock at IBM.
(We are also, and think we're farther along than anyone else but aren't talking about it publicly yet so no need to believe me. There are a few others in a similar state)