3 ms·

80legs automatically handles the crawl rate limits for you.

• codepoet 17y ago
  That's probably not the primary reason to use 80legs - but avoiding to implement a whole crawler.