Also, there seems to be a huge difference between scraping 100,000 pages per hour vs. one page every few seconds. The kind of scraping I am considering would b

Also, there seems to be a huge difference between scraping 100,000 pages per hour vs. one page every few seconds. The kind of scraping I am considering would be the latter and, even at that, it would only happen a few days per month.