4 ms·robots.txt tells the search engine which content is relevant. That's all.by lakomen 3y agorobots.txt tells the search engine which content is relevant. That's all.