I've seen many interpretations of this article and I'm curious as to the mainstream CS reading of it. One could look at the move from linear models to non-line

I've seen many interpretations of this article and I'm curious as to the mainstream CS reading of it. One could look at the move from linear models to non-linear models or the use of ConvNets (yes I know ViTs exist, to my knowledge the base layers are still convolution layers) as 'leveraging human knowledge'. Only after those shifts were made did the leveraging of computation help. It would seem to me that the naive reading of that quote only rings true between breakthroughs.