3 ms·
So, scraping data at scale is fine until they rate-limit you or cut you off. Which means if you used a botnet and rate-limited yourself "just to be safe" or "ju
by EGreg 7y ago
So, scraping data at scale is fine until they rate-limit you or cut you off. Which means if you used a botnet and rate-limited yourself "just to be safe" or "just to be nice" without knowing whether they liked it or not, then that's fine.