3 ms·
> You are literally picking on the last org on the internet that needs to get picked on. True but at the same time I do understand those who generally want oth
by cJ0th 9y ago
> You are literally picking on the last org on the internet that needs to get picked on.
True but at the same time I do understand those who generally want others to abide by their Robots.txt. INAL, but ideally I would love to see the IA having the right to ignore Robots.txt (however, if some one wants to opt out of the IA they should be given the option) while others shouldn't be allowed to do so.