3 ms·
Since 'hsikka is here in the thread - wondering if you can clear up a question that I have from your article. In the FastAI course, they use the descending lim
by carbocation 7y ago
Since 'hsikka is here in the thread - wondering if you can clear up a question that I have from your article.
In the FastAI course, they use the descending limb of the one-cycle curve to set learning rate cutoffs. So I was expecting to see your final model fit with learning rates between ~3e-4 and ~5e-2. However, you used 1e-6 and 1e-4, basically on the flat portion of the curve. That seemed to work just fine for you.
Am I correct that you didn't follow the standard recommendations for the learning rate from one-cycle, or is there some mismatch with the figure?