3 ms·AdamW and Super-convergence is now the fastest way to train neural nets2 points by tsaprailis 8y ago