4 ms·

They do not need to worry about websites and CDN's that would mark their spiders as such. They get free scrapers thanks to that.