3 ms·
Google to stop supporting noindex directive in robots.txt (2019)
- mxxx 6y agoI ran into this the other day. Google will disregard robots.txt and will instead honour the noindex meta tag; BUT if you have a robots.txt that disallows the file with the noindex meta tag then it won’t honour either. Thanks google.