For what it's worth, I think it's also possible that the models stall as the Internet is filled with more and more generated content, and they're unable to dist

For what it's worth, I think it's also possible that the models stall as the Internet is filled with more and more generated content, and they're unable to distinguish between generated and authentic content and eat their own tails. It won't actually stop them from existing and generating content but it could make training them very expensive, as you might have to commission your training set instead of harvesting it. Perhaps we'll place more of an emphasis on real world interactions. Who knows. I'm concerned but I don't think it will be a total loss of reality. But I can't rule it out of course.