3 ms·
It’s ethical when your average Joe does it on a small scale to scrap their favorite favorite YouTuber or to buy something when it becomes available. When you h
by wiseowise 3y ago
It’s ethical when your average Joe does it on a small scale to scrap their favorite favorite YouTuber or to buy something when it becomes available.
When you have financial incentive to build your business on someone’s data and you scrap literally millions if not billions of pages - it’s unethical.
- specproc 3y agoThe thing with social media platforms is that this data is user-generated, so you've got the company "owning" user content. This data is often of great public value. I track conversations around a social issue as part of my work for a non-profit. I'd counter it's unethical to prevent people from accessing this data.
- jnsaff2 3y agoI’m not disagreeing with your comment but > great public value Having been to twitter mostly through the most recent prominent war, man the signal to noise ratio is really low even when being careful about who to follow and who to block. There is so much disinformation, bad takes, uninformed opinions presented as facts, pure evil, etc. So I guess it could be used for training very specific things or cataloging the underbelly of humanity but for general human knowledge it’s a frigging cesspool.
- specproc 3y agoOK, not gonna argue with that. There is, I guess, a perception that it matters because policy-makers, and the wonks and hacks that influence them are hooked. The value for me (and ergo the public, some classic NGO thinking there for you) lies in understanding those dynamics. I do not use the Twitters myself, and actively discourage others from doing so. Sends people bonkers.
- lmeyerov 3y agoI mean, we have found election manipulations like large-scale inauthentic activity of out-of-staters explicitly targeting African Americans, and projects here even to the extent of the perpetrators getting indicted. Other projects were tracking vaccine side-effect self-reports faster than the CDC and other disaster intelligence. We were actually gearing up to switch to paid accounts as we found use cases that could subsidize these efforts... And then the starting price for reasonably small volumes shot up to like $500k/yr.
- bojo 3y agoSo, are we saying it's unethical for Google and other search engines who make money off of ad revenue to scrape sites like Twitter? Or are they paying a large sum to Twitter to do this?
- spullara 3y agoWhen there is a value exchange between the two entities that are relatively similar then I think it is ethical. People trade Google making money on ads for their site being found when people search. It is also possible to opt-out.
- wiseowise 3y agoThey benefit mutually from their symbiosis. Financially, AI bro model #1321 doesn’t bring anyone value except their owners.
- max51 3y agoBeing indexed by google is optional. Twitter could stop it a any time if they thought it was a bad deal for them. That not comparable to a startup company trying to scrape the entire site to train their AI and using sophisticated techniques to bypass protections Twitter has put in place
- raincole 3y agoIf Google doesn't provide a way to say "please don't scrape my site", then it 100% unethical. We have robots.txt. If Google doesn't respect that, it's unethical. Don't you think so?
- pcthrowaway 3y agoMaybe it's time for an llm.txt Not that the people you want to respect that would
- raincole 3y agoThe tricky part is it's much more harder to prove that they didn't respect that.
- pdntspa 3y agoExcept with modern software, some wannabe genius programmer will think they can get a bunch of money or cred or whatever by infantilizing the process down to something your grandma could use. Then, suddenly, everyone is scraping. The net effect is largely the same -- server operators see an overwhelming proportion of requests from bots. Still ethical?
- kergonath 3y agoTranslation: it’s ethical when I do it.
- wiseowise 3y agoYou wouldn’t download a car, would you?