3 ms·You can always disregard robots.txt.. ;)by shadowpwner 16y agoYou can always disregard robots.txt.. ;)