4 ms·
> Why would googlebot use a different header to pretend that it is a user in order to recieve a broken page? That would not benefit any party. Well... it would
by murrayh 18y ago
> Why would googlebot use a different header to pretend that it is a user in order to recieve a broken page? That would not benefit any party.
Well... it would benefit Google (and its users), because they could detect and punish cloaking. How would Google detect cloaking? A clerk examining the two served versions, or automagically comparing the two versions of served content? How smart would their comparing algorithm be? Could it determine that your site was not being deceptive? How would you write such a algorithm (and it better be generic, and difficult to exploit)?
Basically, I have no idea what the hell Google does and does not do, but I am scared (and ignorant) enough to always serve search engines exactly what I serve users.