2 ms·Exactly, so they should ignore robots.txt !by s3p 2y agoExactly, so they should ignore robots.txt !