4 ms·
Isn't one big issue that any website that has data worth scraping has ToS that disallow scraping? e.g. craigslist? Would think this is a legal concern...
by shtopointo 5y ago
Isn't one big issue that any website that has data worth scraping has ToS that disallow scraping? e.g. craigslist?
Would think this is a legal concern...
- colecut 5y agoCan breaking terms of service result in anything more than being banned from the site you are scraping?
- sovnade 5y agoAlso it's very easy to get blacklisted if you scrape too often or too quickly. You definitely have to be "polite" about it.
- fifilura 5y agoWhat about government/municipality data? We paid for that once, surely it shouldn't be necessary to charge for it again?