3 ms·
I know one of my clients - that does a lot of web scraping uses a proxy service - I think maybe 30 or so different proxies and breaks up the jobs manually. So
by mswen 10y ago
I know one of my clients - that does a lot of web scraping uses a proxy service - I think maybe 30 or so different proxies and breaks up the jobs manually. So if those ever get blocked they would need to go through the code and update to a bunch of new proxy IP addresses.
I would think a slick service that had hundreds or thousands of proxies and a good way to rotate scrappers through the proxies automatically would be of use to them. I have no idea what they pay for their current service.