3 ms·

I disagree with you at one point. A site that provides information may not want the information to be indexed. For example, an escort girl's website may just w

I disagree with you at one point. A site that provides information may not want the information to be indexed. For example, an escort girl's website may just want to show portfolio of pictures to her potential clients, but she will not want Google to index them. Information is to be consumed by human. Sometime we may just want to keep machines to access it.

aflag 19y ago
That's what robots.txt is for.
- eugenejen 18y ago
  But right click on the image and "save the image" beats the robots.txt, too. The in the previous example, this girl just don't want any pictures to be saved by anyone.