There are services dedicated to scrapping which can take care of proxy-ing your requests so you don't have to worry about IP bans. For example, Scrapinghub's C

There are services dedicated to scrapping which can take care of proxy-ing your requests so you don't have to worry about IP bans. For example, Scrapinghub's Crawlera (the guys behind the Scrapy python lib)