2 ms·

Yes, this has been the traditional reason for robots.txt -- protects the bot as much as it does the site.