4 ms·

Absolutely. If it's automated and can be used on many different pages (basically a bot script), it should respect robots.txt.