3 ms·
“Pull back the covers on large scale deep learning models and this is one reason overfitting creates miraculous accuracy. Large scale models have a primitive un
by jwilber 5y ago
“Pull back the covers on large scale deep learning models and this is one reason overfitting creates miraculous accuracy. Large scale models have a primitive understanding of the deformations leading to a degree of generalization. The more the model learns about how the inference space changes over time, the better it generalizes.“
Pretentious mention of topology followed by super broad, almost completely incorrect characterization of the double descent phenomena, color me surprised.