> If you don't want to be indexed, you can just put the appropriate entry in robots.txt and all the major search engines will comply. Just to be clear, it's no

> If you don't want to be indexed, you can just put the appropriate entry in robots.txt and all the major search engines will comply. Just to be clear, it's not really Google's crawling that I meant to criticize, but rather the double standard employed by the majority of website owners that strengthens Google's monopoly. If anything, I wish more website owners wouldn't mind automated use and copying of their site from anyone and not just major players like Google.