4 ms·
> It’s a form of credit inflation. Researchers want sweet, sweet deep learning hype credit for fame & fortune. The authors of the AdamW or super-convergence pa
by jph00 8y ago
> It’s a form of credit inflation. Researchers want sweet, sweet deep learning hype credit for fame & fortune.
The authors of the AdamW or super-convergence papers did not write the blog post - we did. There is no connection between the authors of the papers mentioned and the authors of the blog post.
It's simply a genuine and honest attempt by us to study these papers and share what we learned, in order to help others get similar results.
- mlthoughts2018 8y agoI was referring only to the fastai post plugging the fastai toolkit. The research papers themselves seem fine enough, as they aren’t making a bombastic claim like saying AdamW + 1cycle should be considered the general default starting point for training any NN.