4 ms·

I remember reading on HN years ago that Google bots have never honored robots.txt, but I don't actually know