5 ms·
And of course, if you change the Referer header to http://www.google.com/ http://www.google.com/, you get a different page with the solution at the bottom. I f
by barrkel 16y ago
And of course, if you change the Referer header to http://www.google.com/ http://www.google.com/, you get a different page with the solution at the bottom.
I find myself wondering though - why don't they get punished more for feeding different content to the GoogleBot vs what the normal viewer sees? Isn't it basically cloaking - even though clicking on the link in Google search results will still serve up the solution, a normal, organic link wouldn't?
http://googlewebmastercentral.blogspot.com/2008/06/how-google-defines-ip-delivery.html http://googlewebmastercentral.blogspot.com/2008/06/how-googl...
"Cloaking: Serving different content to users than to Googlebot. This is a violation of our webmaster guidelines. If the file that Googlebot sees is not identical to the file that a typical user sees, then you're in a high-risk category. A program such as md5sum or diff can compute a hash to verify that two different files are identical."
- bobds 16y agoGoogle sort of encourages this kind of cloaking. It's called First Click Free. http://www.google.com/support/webmasters/bin/answer.py?hl=en&answer=74536 http://www.google.com/support/webmasters/bin/answer.py?hl=en...
- barrkel 16y agoOf course, I had forgotten...
- lwat 16y agoGoogle should reconsider their position on this I think.
- nostrademons 16y agoIf Google reconsidered their position on this, a vast archive of subscription-only NYTimes, Financial Times, WSJ, etc. content would suddenly become inaccessible. I can't count the number of times I've seen an interesting article on Reddit or HN, clicked through, found myself butting up against a paywall, and then just Googled the title and been able to read the whole thing for free. You think that these companies would suddenly put their whole archives online for free if they didn't get a bunch of search traffic for it?
- mambodog 16y agoMaybe Google doesn't want holes appearing in their searches when major sites go behind paywalls (newspapers?).