3 ms·
Excellent article! I'd be really curious to see a treatment of the same topic, but with ADAM.
by bmh 7y ago
Excellent article! I'd be really curious to see a treatment of the same topic, but with ADAM.
- jing 7y agohttps://www.fast.ai/2018/07/02/adam-weight-decay/ https://www.fast.ai/2018/07/02/adam-weight-decay/