2 ms·So, I guess that there's an one-line script in robots.txt to prevent Google from crawling my website?by BlueTemplar 7y agoSo, I guess that there's an one-line script in robots.txt to prevent Google from crawling my website?