4 ms·
Adam/AdamW doesn't follow any intuitive logic. Pretty much everyone has different experiments with setting learning rates and schedules.
by minimaxir 3y ago
Adam/AdamW doesn't follow any intuitive logic. Pretty much everyone has different experiments with setting learning rates and schedules.