3 ms·IA should start respecting robots.txt disallow, because right now they ignore it.by PatrolX 6y agoIA should start respecting robots.txt disallow, because right now they ignore it.