There was actually a very recent blog post claiming that statistical mechanics can explain double descent https://calculatedcontent.com/2024/03/01/describing-do

There was actually a very recent blog post claiming that statistical mechanics can explain double descent https://calculatedcontent.com/2024/03/01/describing-double-descent-with-weightwatcher/ https://calculatedcontent.com/2024/03/01/describing-double-d... Some more detail here: https://calculatedcontent.com/2019/12/03/towards-a-new-theory-of-learning-statistical-mechanics-of-deep-neural-networks/ https://calculatedcontent.com/2019/12/03/towards-a-new-theor...