3 ms·robots.txtby benji-york 9y agorobots.txtgspetr 9y agohttps://www.google.com/killer-robots.txt https://www.google.com/killer-robots.txt