2 ms·

Hi! The robots file is not a text file. I know! Products blocked due to possible copyright infringement. A lot are disputes over product name or t-shirt slogan

by woonord 12y ago

Hi! The robots file is not a text file. I know! Products blocked due to possible copyright infringement. A lot are disputes over product name or t-shirt slogan. We were ranking for some terms we did not want to be associated with so we added the offending search result page to the file. Not sure how it ever got indexed in the first place. Peace!

simonebrunozzi 12y ago
I like you already :)
filmgirlcw 12y ago
awesome response!
woonord 12y ago
thanks! I have some inside knowledge!
- toephu2 12y ago
  as in you work at nordstrom?
  - woonord 12y ago
    kinda sorta maybe
troels 12y ago
I don't think you actually want to do that. Blocking in robots.txt will prevent Google from crawling the URL - not from indexing it. You actually want them to crawl the URL and then respond with a 404 or 410. If there are inbound links pointing to that URL, you should disavow them in GWT.
- eli 12y ago
  a "noindex" robots meta tag would work too
lucasjans 12y ago
Why you're at it - can you unblock traffic from Vietnam? I know a few people here who want to order online (through a courier) but can't and aren't capable of VPNing. Plus, isn't blocking entire countries from accessing your site against the spirit of the internet? Edit: this is what we see from Vietnam - https://cloudup.com/cOLr9vimmIC https://cloudup.com/cOLr9vimmIC