4 ms·
How do you handle sites that have scraper prevention? Such as captcha, IP throttling, etc. I'd pay $100-$500 per-month for a service that could reliably scrape
by throwaway12s34 9y ago
How do you handle sites that have scraper prevention? Such as captcha, IP throttling, etc.
I'd pay $100-$500 per-month for a service that could reliably scrape some particularly difficult sites. With that being said, I'd need the service to be able to handle ~100 req/s in bursts and 2-4 req/s on average.