So many people don't even think about number of requests and often want the job to end as quickly as possible. For me, that is thinking short term, I've seen re

So many people don't even think about number of requests and often want the job to end as quickly as possible. For me, that is thinking short term, I've seen requests per second as low as 4 cause performance issues for a company. If you want to scrape long term you need to think requests per minute. That is unless you're dealing with a mega site then it's keeping a low request per second.