That may very well be because the datasets are not large enough to densely cover the underlying data distribution - which is what these current deep learning mo

That may very well be because the datasets are not large enough to densely cover the underlying data distribution - which is what these current deep learning models need. Francois Chollet talked about it on Twitter and in some of his papers. An exciting possibility that is opened by these generative models is synthetic data. Train (well) a generative model on private data, then share the generated syntetic data without privacy violation concerns. Of course, this opens the way to data laundering - profiting from ilegally obtained data that you're not supposed to have. Possibly by laundering through several jurisdictions, where each local step is legal. What will be the Dutch sandwich of data laundering ? The cyber dystopian novels of the 90s have nothing on this.