3 ms·
$ curl -v -A Googlebot example.org $ curl -v -e www.google.com example.org
by cantlin 14y ago
$ curl -v -A Googlebot example.org
$ curl -v -e www.google.com example.org
- michaelmior 14y agoI was going to post the same thing. Fetch as Googlebot is nice but really nothing too special.
- joshu 14y agoYou are wrong. Stop guessing and then acting like your guesses are facts.
- michaelmior 14y agoWhat I am guessing? Your comment does nothing to clarify any mistake I might have made, which I'll gladly admit to. There are certainly differences between just setting the user agent and running Fetch as Googlebot. (The incoming IP address being an obvious one.)
- RKearney 14y agoUnfortunately this does not magically make your request come from Google's IP block for their web crawlers. Just as easily as the attacker put in User Agent checks, they could have put in source IP checks.