3 ms·
Pre-AI internet data is like pre-war steel The slop would multiply if we keep feeding it to new models in a loop
by speedping 18d ago
Pre-AI internet data is like pre-war steel
The slop would multiply if we keep feeding it to new models in a loop
- Muromec 18d agoThis is one of the problems that eventually solves itself, somehow
- hasteg 18d agoThis is likely being solved with stuff like watermarking which Anthropic just added to Claude... I'd imagine they are testing new data and verifying that training data (or at least the data which do NOT want to be AI generated, i.e actual human text) is not generated, at least with claude.