3 ms·You'd prefer they didn't honor robots.txt at all?by Tloewald 11y agoYou'd prefer they didn't honor robots.txt at all?