4 ms·
ELI5 which features of double descent evoked tunnelling to you?
by gsf_emergency_6 10mo ago
ELI5 which features of double descent evoked tunnelling to you?
- aebtebeten 10mo agoIf we look at "twice made dips", we say two times as there is first a dip, then a peak (rise and dip), and then the next dip. This is like when one hops the band gap: there is first a free wave, then one that looks like it dies out, but if it is still a bit big by the end of the gap, then it goes on to the next free wave.
- gsf_emergency_6 10mo agoBloch oscillations? Didn't see that coming tbh. ELIgs then
- aebtebeten 10mo agoNo, not so fancy (do they arise from interference from the internal reflections?). In standard tunnelling, one starts with a normal oscillation, goes to evanescence in the "tunnelling" regime, and then continues with oscillation again once on the low side of the potential; in double descent the test error goes way up (like the potential earlier) in the "tunnelling" regime, and then on the far side comes back down and then continues descending. Have I explicated my model?
- gsf_emergency_6 10mo agoWhy say "bandgap" when you mean "potential wall" :) So test-error is sampling a (thermodynamic) potential?
- aebtebeten 10mo agoI don't think really so; just riffing off a similar "surfer dives under a wave" pattern — but if you could make it work I'm all ears! None of "confinement", "energy", or "level" work in my take on "ELI5"; that is why :) (when I have more time should I try an eight part 文 in words like this?)