There are first studies on this topic: "THE CURSE OF RECURSION: TRAINING ON GENERATED DATA MAKES MODELS FORGET" https://arxiv.org/pdf/2305.17493.pdf https://ar

There are first studies on this topic: "THE CURSE OF RECURSION: TRAINING ON GENERATED DATA MAKES MODELS FORGET" https://arxiv.org/pdf/2305.17493.pdf https://arxiv.org/pdf/2305.17493.pdf