3 ms·
Is there actually any plausible theory why "AI" would repeatedly scrape the same sites? Are there that many competing, completely independent AI labs? Is it che
by lxgr 5mo ago
Is there actually any plausible theory why "AI" would repeatedly scrape the same sites? Are there that many competing, completely independent AI labs? Is it cheaper to repeatedly scrape than to buffer the scraped data locally? (I find it very hard to imagine that it's easier to deal with changing/disappearing content than it is to stand up such a cache.)
- jack_pp 5mo agoIf you ask an agent to check sources / function definitions of open source packages it will wget / curl it
- GoblinSlayer 5mo agoIt's an AI generated scraper that scrapes nonstop.