3 ms·
1) Scrapers often rotate ip per request, rate limiting doesn’t help
by sunnybeetroot 3mo ago
1) Scrapers often rotate ip per request, rate limiting doesn’t help
- codedokode 3mo agoRate limiting requires them to buy more IPs (which are not free) and slows down scraping.
- sunnybeetroot 3mo agoYes, that’s what the big scrapers are doing (frontier AI labs). They have infinite money for this.