My bet is on large-scale databases and data engineering. AI is hyped, but the sad truth is that a lot of the recent advances come from bigger models and making

My bet is on large-scale databases and data engineering. AI is hyped, but the sad truth is that a lot of the recent advances come from bigger models and making use of more data. Historically the same thing has happened a few times [0]. It's no different this time. Recent advances like big transformers, self-supervised learning, etc, are more examples of that. Even the initial convnet breakthrough in 2012 was possible only because we figured out how to process a large dataset efficiently on a GPU. Companies will realize that they don't yet need Data Scientists or AI researchers. They need engineers that are really good at building data pipelines, event stores, feature stores, and databases specific to various query patterns. Or perhaps one to rule them all. [0] http://www.incompleteideas.net/IncIdeas/BitterLesson.html http://www.incompleteideas.net/IncIdeas/BitterLesson.html