2 ms·And this constitutes evil for you? A really aggressive robots.txt?by dsacco 9y agoAnd this constitutes evil for you? A really aggressive robots.txt?