3 ms·
The paper discussed showed on reddit a few months back [1]. Another paper showed up shortly after claiming the exact opposite [2]. Some discussion of contradict
by scythmic_waves 6y ago
The paper discussed showed on reddit a few months back [1]. Another paper showed up shortly after claiming the exact opposite [2]. Some discussion of contradiction this can be found in this part of the thread: [3].
I myself am very interested in [2]. It's fairly dense, but I've been meaning to go through it and the larger Tensor Programs framework ever since.
[1] https://www.reddit.com/r/MachineLearning/comments/k7wj5s/r_every_model_learned_by_gradient_descent_is/ https://www.reddit.com/r/MachineLearning/comments/k7wj5s/r_e...
[2] https://www.reddit.com/r/MachineLearning/comments/k8h01q/r_wide_neural_networks_are_feature_learners_not/ https://www.reddit.com/r/MachineLearning/comments/k8h01q/r_w...
[3] https://www.reddit.com/r/MachineLearning/comments/k8h01q/r_wide_neural_networks_are_feature_learners_not/geya33m/ https://www.reddit.com/r/MachineLearning/comments/k8h01q/r_w...
- Grimm1 6y agoThank you! Number 2 was exactly what I was looking for and I just couldn't find the link.