2 ms·
> Another thing I find mildly strange is that the help for certain countries is restricted. This is not what robots.txt should be used for, and it creates incen
by zinekeller 5y ago
> Another thing I find mildly strange is that the help for certain countries is restricted. This is not what robots.txt should be used for, and it creates incentive for bots to disregard robots.txt.
It seems that they did exist, but moved to specific TLDs (like for Brazil, https://www.nike.com.br https://www.nike.com.br). Lazy that they didn't redirect all help files to the correct location though.
- deleted 5y ago[deleted]