3 ms·
https://www.cl.cam.ac.uk/~is410/Papers/dementia_arxiv.pdf https://www.cl.cam.ac.uk/~is410/Papers/dementia_arxiv.pdf As another commenter here said a while back
by srslack 3y ago
https://www.cl.cam.ac.uk/~is410/Papers/dementia_arxiv.pdf https://www.cl.cam.ac.uk/~is410/Papers/dementia_arxiv.pdf
As another commenter here said a while back, pre-2021 web crawls will be like the low background steel of the web.
- tyingq 3y ago"Definition 3.1 (Model Dementia). Model Dementia is a degenerative process affecting generations of learned generative models, where generated data end up polluting the training set of the next generation of models; being trained on polluted data, they then mis-perceive reality. " Ah, it has a name even, so I'm at least not alone in thinking it's an issue.