4 ms·
1. The theory by now is filling bookshelves, so forget learning about "the theory". Learn the foundation (to see where you're niche --e.g. optimization for full
by data_maan 4y ago
1. The theory by now is filling bookshelves, so forget learning about "the theory". Learn the foundation (to see where you're niche --e.g. optimization for fully connected NNs; last I heard it should be done by second-order methods if you have the computing power-- fits in) and then learn the niche's theory.
This will require at least upper undergraduate level math BTW.
2. You could get by knowing the theory in a handwavy way. Not ideal but I've seen people do it. For implementation that is enough in many case.
3. Again, "research" is too general. While you might understand some experimental ICML papers, it's very unlikely you will understand a single COLT paper if you don't know a lot of math.