I am probably in the minority, but I try to outsource scraping whenever possible. It's too much grunt work: you have to constantly baby sit the crawlers that br

I am probably in the minority, but I try to outsource scraping whenever possible. It's too much grunt work: you have to constantly baby sit the crawlers that break because websites keep changing. Personally, I use Indexed (https://www.indexedinc.com https://www.indexedinc.com) because they are technical and reliable, although there are many other providers out there..