3 ms·
Big brains divided over training AI with more AI: Is model collapse inevitable?
- Bluestein 3y ago"""AI model collapse – the degradation of quality expected from machine learning models that recursively train on their own output – is not inevitable, at least according to 14 academics. The risk that ongoing generative AI output, known as synthetic data, will dilute human-created organic data and impair the performance of models trained on this increasingly fabricated corpus was highlighted by a separate group last year, in a paper titled: "The Curse of Recursion: Training on Generated Data Makes Models Forget." Ilia Shumailov, lead author of that paper, spoke to The Register earlier this year about this phenomenon, which has been documented in other studies. Now another set of boffins – Matthias Gerstgrasser, Rylan Schaeffer, Apratim Dey, Rafael Rafailov, Henry Sleight, John Hughes, Tomasz Korbak, Rajashree Agrawal, Dhruv Pai, Andrey Gromov, Daniel Roberts, Diyi Yang, David Donoho, and Sanmi Koyejo – contend that the problem of training AI on AI-made data isn't significant, given the way that model training is actually done."""
- cratermoon 3y agoIt seems the solutions the boffins suggest is "just don't train the AI on AI-generated data". As if it's easy to know which is which, and companies will spend money and time trying to separate the two in their their training sets.
- Bluestein 3y agoIt's a "poisoned well" type of scenario. Once the cat is out of the bag. Like mixing two liquids ...
- bcrl 3y agoExcept that there's no way to reliably determine what data is generated by AI. I strongly believe there should be a registry of data created by generative AI so that society can track and better determine how to handle the tsunami of crap that's coming. Making the digital creation of spam and scams tailored to individuals cheaper cannot possibly result in a good outcome.