4 ms·
> For example, can you give a proof of superconvergence? What’s the exact learning rate that causes it, and why? Did you know that you can often get away with a
by ganzuul 7y ago
> For example, can you give a proof of superconvergence? What’s the exact learning rate that causes it, and why? Did you know that you can often get away with a high learning rate for a time, and then divergence happens? What’s the proof of that?
Would Neural Tangent Kernels help with this, or are they just as impenetrable as latent spaces?