3 ms·Google respects robots.txt files from webmasters who don't want Google to scrape their contentby Breza 7y agoGoogle respects robots.txt files from webmasters who don't want Google to scrape their content