I guess time will really tell. We might as well hit the problem Google Translate hit, where the training set started to contain more and more data created from

I guess time will really tell. We might as well hit the problem Google Translate hit, where the training set started to contain more and more data created from GT itself. Similar thing may happen with your NN. At some point there may be so much AI-generated content (by different AIs) that it may be difficult to compose a trustworthy training set.