4 ms·

Plus very easy to parallelize

• amelius 9y ago
  Unless the websites work together to protect themselves against crawlers that work that way (e.g., rejecting requests to different hosts from the same origin within a time interval).