4 ms·
Since it scrapes Google, how does it manage to not get your server IP blocked?
by slig 10y ago
Since it scrapes Google, how does it manage to not get your server IP blocked?
- greglindahl 10y agoIt doesn't. The idea is that you'll run your own personal instance, and traffic will be low enough to not set off anyone's defenses. You'll see this discussed if you look at the issues, and in the code you can see that it supports using proxies and multiple IPs on hosts which have multiple IPs.
- visarga 10y agoIf you run your own, then it's not private any more. Your server IP will identify your searches, and only your searches.
- mintplant 10y agoPerhaps one could tunnel it through Tor, rotating identities regularly. There is the issue of dealing with Google's aggressive reCAPTCHA challenges to connections made through Tor, however.
- ScroogeMcDoug 10y agoHistorically, I've found Google search borderline impossible to use via Tor because it'd usually give me an error page after solving the captcha. Occasionally you'll find a window where they're not nulling Tor IPs, but it's rarely worth the time.