2 ms·
So, I know the folks who do DOS protection for Google, and...well, good luck. Scrapers get blocked, and the folks in charge of that are very, very good at what
by nostrademons 12y ago
So, I know the folks who do DOS protection for Google, and...well, good luck. Scrapers get blocked, and the folks in charge of that are very, very good at what they do. Your best bet is probably to put up with the slow query rate and mimic ordinary user traffic. You really, really do not want to end up on Google's bad side.
- Jake232 12y agoGoogle isn't that difficult to scrape. I've worked on numerous projects doing it and it just takes a little thinking outside the box and a few proxies.