2 ms·
On the consumer side, I'm happy with the following rules. I'm happy writing a program to let individual users scrape from their computers. After all, they have
by DanielBMarkham 17y ago
On the consumer side, I'm happy with the following rules.
I'm happy writing a program to let individual users scrape from their computers. After all, they have a right to visit the site and retrieve their data in whatever format suits them.
I'm not so keen on setting up a server to scrape data, or having a server scrape a huge pile of data for a list of users. After all, whoever is running the service is keeping stuff for all of the users. My taking it all is just stealing.
On the provider side, I think my feelings are about the same. I think you have to be careful that you leverage scraping -- let scrapers come in and get enough stuff that it makes people want to visit, but not so much that they have everything. If executed effectively, you can use scraping to great benefit.