Relying on a third party to "do the right thing" is a dangerous path to take. It's like putting up a robots.txt and saying it's up to the crawler programmers/u

Relying on a third party to "do the right thing" is a dangerous path to take. It's like putting up a robots.txt and saying it's up to the crawler programmers/users to respect the rules.