3 ms·
It's because they don't give a shit whether the product works properly or not. By blocking AI scraping, sites are forcing AI companies to scrape faster before t
by immibis 1y ago
It's because they don't give a shit whether the product works properly or not. By blocking AI scraping, sites are forcing AI companies to scrape faster before they're blocked. And faster means sloppier.
- lovich 1y agoThere’s also the point that if the web site is down after you scraped it, then that’s 1 more sites data you’ve scraped that your competition now cant