Isn't the CNN a discovery in itself? Without it, we'd be following the bitter lesson and "leveraging computation" to throw more data / compute at an MLP. Clear

Isn't the CNN a discovery in itself? Without it, we'd be following the bitter lesson and "leveraging computation" to throw more data / compute at an MLP. Clearly someone felt that there'd be a better inductive bias and attempted something else, and now CNNs are what's used "in the long run".