robots.txt is really only like a note on the front door of your unlocked house that says "please only look at these items in these rooms." or "please do not loo

robots.txt is really only like a note on the front door of your unlocked house that says "please only look at these items in these rooms." or "please do not look in my house" If someone wants to write a program to index the site they can still do so. Google, MSN, Bing, yahoo, et. al. will respect the robots.txt file though.