I worked for a company that essentially was based on it, and know of another that via "scraping" and related automation makes its living as well. Both have been

I worked for a company that essentially was based on it, and know of another that via "scraping" and related automation makes its living as well. Both have been alive and well for years and have grown quite a bit. The trick is that you work with the companies/sites you are scraping from the beginning as a business relationship of some kind if possible, and not as a parasitic relationship. Basically if you are trying to help them sell their products/services/data and they benefit, even though you will likely have to fix the "scrapers" all the time, it works out.