3 ms·
> actually a fairly complicated subject This is heavily dependent on your background. Deep learning is essentially the simplest thing that could possibly work
by twtw 8y ago
> actually a fairly complicated subject
This is heavily dependent on your background. Deep learning is essentially the simplest thing that could possibly work (parameterized nonlinear function + SGD).
If you have experience with calculus roughly equivalent to an undergrad Calc 3, which is required for most fields of engineering, the core ideas of deep learning are very accessible to you without much effort.
After that, getting it to work is mostly an empirical and experimental endeavor.
(This refers to deep learning as used in practice, not some of the current research topics).
- AstralStorm 8y agoSometimes, deep learning is too simple to actually work. (complex games with hidden state, exploration, generating art, decision making etc.) Those use cases are in constant flux and research. (Though teams like DeepMind are making some serious inroads.) Other problem is that DL is still highly sample inefficient - it needs many more examples than you'd want or sometimes even have to bootstrap.