> It's pointless to write a whole article about how model collapse is actually happening and isn't just a theoretical concern with no evidence that model collap

> It's pointless to write a whole article about how model collapse is actually happening and isn't just a theoretical concern with no evidence that model collapse is actually happening. Except perhaps the link to article on the peer-reviewed paper that describes the problem in detail. https://www.cs.ox.ac.uk/news/2356-full.html https://www.cs.ox.ac.uk/news/2356-full.html > Researchers at Oxford and Cambridge published work on this back in 2023, showing how iterative training on synthetic data leads to progressive degradation.