4 ms·Unless they're obeying robots.txt, which they probably should beby JeffJenkins 17y agoUnless they're obeying robots.txt, which they probably should be