3 ms·
This assertion regarding quality sounds like an appealing but probably wrong guess, like curse of dimensionality.
by meltyness 3y ago
This assertion regarding quality sounds like an appealing but probably wrong guess, like curse of dimensionality.
- tyingq 3y agoThere's other related issues too, though. Like, the incentive to publish "good stuff" goes down, as there's much less quid-pro-quo traffic from Google to reward the work. You're right in that I'm guessing, but Google does seem to be headed down a road of eating itself.
- srslack 3y agohttps://www.cl.cam.ac.uk/~is410/Papers/dementia_arxiv.pdf https://www.cl.cam.ac.uk/~is410/Papers/dementia_arxiv.pdf As another commenter here said a while back, pre-2021 web crawls will be like the low background steel of the web.
- tyingq 3y ago"Definition 3.1 (Model Dementia). Model Dementia is a degenerative process affecting generations of learned generative models, where generated data end up polluting the training set of the next generation of models; being trained on polluted data, they then mis-perceive reality. " Ah, it has a name even, so I'm at least not alone in thinking it's an issue.