3 ms·
I see a difference between "scrape for personal use", "scrape for public good" and "scrape to earn money from". Everything is fine for personal use - you are c
by theamk 3y ago
I see a difference between "scrape for personal use", "scrape for public good" and "scrape to earn money from".
Everything is fine for personal use - you are choosing how to consume the websites, and if you choose to do it by extracting all the data into tables, that's fine.
Public good scraping is slightly murkier morally but I guess it's also fine? Similar to "fair use" copyright exceptions. (Unless it's commercial companies pretending to do "public good" solely for their own benefits, like AI "open dataset". Those should be banned.)
"Scrape to earn money from" is not OK. And sadly, this seems to be the majority of all scraping projects, such as: copy the sites wholesale and display your own ads on them, collect data to train AI on, for SEO (=make everyone's search results worse).
The good analogy is what would you do in a public place like a cafe: can you do your personal work? No problem at all. Can you put a non-commercial poster or sign? This may be OK. Can you earn money off it (say sell your own stuff inside)? No way.
- sangnoir 3y ago> Scrape to earn money from" is not OK. This is exactly how search engines like Google and Bing work though. So I don't think "earning money" is the right place to draw the line. Reproducing websites wholesale is also illegal and immoral IMO, but there's a lot of gray area between search engines and cloning the content of entire websites to slap ads on.