3 ms·
I'm not sure if I should focus on the detailed logo at the end or the allowed parts for Chinese spiders (especially that it's not blocked for other spiders - is
by zinekeller 5y ago
I'm not sure if I should focus on the detailed logo at the end or the allowed parts for Chinese spiders (especially that it's not blocked for other spiders - is this how you signal priorities for Chinese spiders?)
Edit: I've now noticed the disallow directive for other countries specifically targeted for Chinese spiders.
- danuker 5y agoIndeed. I am also somewhat puzzled about what there is to see here. I see the Chinese spiders are only allowed on the /cn/ directory, while disallowed from the root (/). Another thing I find mildly strange is that the help for certain countries is restricted. This is not what robots.txt should be used for, and it creates incentive for bots to disregard robots.txt.
- zinekeller 5y ago> Another thing I find mildly strange is that the help for certain countries is restricted. This is not what robots.txt should be used for, and it creates incentive for bots to disregard robots.txt. It seems that they did exist, but moved to specific TLDs (like for Brazil, https://www.nike.com.br https://www.nike.com.br). Lazy that they didn't redirect all help files to the correct location though.
- deleted 5y ago[deleted]
- thrdbndndn 5y agoThis is to make sure they only crawl the Chinese version of their site. It makes sense considering they have this: https://purpose.nike.com/statement-on-xinjiang https://purpose.nike.com/statement-on-xinjiang