3 ms·
Frankly, one does not need this paper to get towards the AI. Adam the optimization algo you might need (and even there I am not sure). And it is very readable.
by lostmsu 4y ago
Frankly, one does not need this paper to get towards the AI. Adam the optimization algo you might need (and even there I am not sure). And it is very readable. The fact that this particular proof of Adam's convergence is complicated is largely irrelevant.
https://arxiv.org/pdf/1412.6980.pdf https://arxiv.org/pdf/1412.6980.pdf
- random314 4y agoYes, if you set the bar low enough - everything is easy and can be learnt in a month.
- lostmsu 4y agoThat's not really an argument for why understanding this is needed to move the field forward. Even your point rests on an assumption, that there's no proof for Adam convergence, that a high school student could understand, which is just a guess at best.