4 ms·

The problem with that is that you could spoof the user agent.

• jonlucc 12y ago
  But Google probably doesn't bother, right?
  • LukeB_UK 12y ago
    What I meant is that a human could spoof the user agent and pretend to be Googlebot.
• desdiv 12y ago
  Googlebot's identity can the authenticated to prevent spoofing: https://support.google.com/webmasters/answer/80553?hl=en https://support.google.com/webmasters/answer/80553?hl=en
• haneefmubarak 12y ago
  Actually, you could do a reverse IP lookup against any user agent claiming to be googlebot followed by a forward IP lookup against the domain name you were returned. Legitimate googlebots will be in the *.googlebot.com space. Source: https://support.google.com/webmasters/answer/80553?hl=en https://support.google.com/webmasters/answer/80553?hl=en