3 ms·Google can even index files listed in robots.txt (it just doesn't crawl them)by eli 15y agoGoogle can even index files listed in robots.txt (it just doesn't crawl them)