5 ms·
Scraping user-generated data should be made a legal right. It’s not like the companies paid for the data they collected from users, and the whole thing is anti-
by Siira 5y ago
Scraping user-generated data should be made a legal right. It’s not like the companies paid for the data they collected from users, and the whole thing is anti-competitive as well, and hurts the economy.
- judge2020 5y agoUGC can range from a Facebook post about tacos to intimate details about one’s private life or medical history. Blanket statements like yours do nothing to help the conversation.
- luffapi 5y agoYou can get only scrape data you are allowed to access. If your eyes can see it, you should be able to scrape it. The analog hole is always there.
- EMM_386 5y agoThis gets very tricky when you think about JavaScript. What if you only pop up important information via an onBlur event in a dynamically created div element that is overlayed on the page, only after asynchronously querying a REST endpoint to get information from a database? How would a crawler even know that this element is shown when you leave a specific input field? How would it know to wait a second while the database is getting the data? Like it or not, we're well past the days of complete HTML documents being served for a request.