4 ms·
That's old hat and ineffective. Scrapers usually proxy through large lists of rotating ip addresses. There are lots of services for it.
by jjeaff 9y ago
That's old hat and ineffective. Scrapers usually proxy through large lists of rotating ip addresses. There are lots of services for it.
- saas_co_de 9y agodepends. if you also do tracking for valid navigation paths then rate limiting may be effective. For instance: if you have a search result with a 1000 pages that someone is trying to scrape if you don't allow people to jump into the middle of the result set then just rotating IPs doesn't work.