3 ms·

robots.txt disallow is ignored for my production site at least. This is super bad.

• nopassrecover 4y ago
  Same for us - we have robots.txt disallow etc. and the relevant headers for personal customer links and Bing is ignoring and publishing all the same