I personally think that there is still enormous room for improvement in applying even modern cutting edge techniques to real world usecases and industry. Also,

I personally think that there is still enormous room for improvement in applying even modern cutting edge techniques to real world usecases and industry. Also, I think interpretability and the introduction of better understood priors will lead to extremely large, sparse networks being used across multiple modalities in applications and software.