It's true that there is no directly predictive model of deep learning, and it's also true that there is some trial and error, but it is wrong to say that theref

It's true that there is no directly predictive model of deep learning, and it's also true that there is some trial and error, but it is wrong to say that therefore there is no operating theory at all. I recommend reading Ilyas 30 papers (here's my review of that set: https://open.substack.com/pub/theahura/p/ilyas-30-papers-to-carmack-table?utm_source=share&utm_medium=android&r=5sutf https://open.substack.com/pub/theahura/p/ilyas-30-papers-to-...) to see how shared intuitions and common threads are clearly developed over the last decade+