4 ms·
The silver lining is that flooding the internet with AI spam is self-defeating since it will taint the training data for future models. Instead of learning to
by jsheard 3y ago
The silver lining is that flooding the internet with AI spam is self-defeating since it will taint the training data for future models.
Instead of learning to immitate humans they'll begin to imitation the imitations, then imitate the imitations of the imitations.
- visarga 3y agoNot like we haven't filled it already with misinformation and blog farm drivel. We need to judge both human and AI content by its utility.
- humanistbot 3y agoEverything in archives pre-2021 is still untainted. All major social media, Q&A, code repos, and archive.org are timestamped. It taints future collection of training data, but not existing collection of training data.
- jsheard 3y agoWhat's the plan then, to coast on pre-2021 data forever? How much utility would todays LLMs have if they were trained on fossilized archives of the internet from 10, 15, 20 years ago?