4 ms·
Model Dementia: Generated Data Makes Models Forget
- iliaishacked 3y agoWhat happens when generated data of one LLM becomes training data of another LLM? Turns out that models start forgetting the real distribution and as the process repeats models develop dementia.