Here's how many URLs we crawl every second with 80legs (http://www.80legs.com http://www.80legs.com) https://dl.dropboxusercontent.com/u/44889964/Descartes%20%

Here's how many URLs we crawl every second with 80legs (http://www.80legs.com http://www.80legs.com) https://dl.dropboxusercontent.com/u/44889964/Descartes%20%20%20Graph%20%20%20%2008.%20Results%20Added%20%20per%20second%20.png https://dl.dropboxusercontent.com/u/44889964/Descartes%20%20... This translates to about 700MM/month. The bump you see this month is just us adding more crawling nodes to our cluster.