Agreed, Greg Yang's work is really interesting. Here's a reddit thread by Yang discussing his research into why NNs are not Kernel Machines [1]. [1] https://w

Agreed, Greg Yang's work is really interesting. Here's a reddit thread by Yang discussing his research into why NNs are not Kernel Machines [1]. [1] https://www.reddit.com/r/MachineLearning/comments/k8h01q/r_wide_neural_networks_are_feature_learners_not/ https://www.reddit.com/r/MachineLearning/comments/k8h01q/r_w...