> If you're surprised by this result because you've used kernel machines and didn't find them very good at generalization, This statement is a bit strange, bec

> If you're surprised by this result because you've used kernel machines and didn't find them very good at generalization, This statement is a bit strange, because most of the theoretical work around NTK assumes that the tangent kernel doesn't change sufficiently during training. This seemed to make this closer to "extreme machines" than deep learning. There was a paper from Francis Bach's group which seemed to be saying as much, but that criticism was no match for the meme-fication of this line of research by over-enthusiastic amateurs.