3 ms·
> data should be radioactive for companies, especially if it approaches PII Cute theory. Fails in practice. Especially with LLMs on the horizon, this would be
by JumpCrisscross 2y ago
> data should be radioactive for companies, especially if it approaches PII
Cute theory. Fails in practice. Especially with LLMs on the horizon, this would be tantamount to unilateral nuclear disarmament. (Practically, it fails in that we haven't quantified the cost of breaches commensurate with what those of us who are security minded estimate it to be.)
I have advocated for privacy issues for a short while. "Data is radioactive" is the "defund the police" of our movement.
- unicamelkje 2y agoI don't see any parallels with unilateral nuclear disarmament and making exploiting user data unviable >we haven't quantified the cost of breaches commensurate with what those of us who are security minded estimate it to be We don't estimate GDPR violations as the true materialized damages either, we put a heavy % of yearly income per offense, large enough to deter it.
- JumpCrisscross 2y ago> We don't estimate GDPR violations as the true materialized damages either, we put a heavy % of yearly income per offense, large enough to deter it Not remotely analogous to turning data into a liability. Particularly when the EU laws seem almost explicitly written to allow for offloading such risks to America and China.
- unicamelkje 2y agoIt's not analoguous, it _IS_ turning data into a liability. It's just more closed in scope than today's topic. > Particularly when the EU laws seem almost explicitly written to allow for offloading such risks to America and China. I don't know what you refer to with this specifically
- deleted 2y ago[deleted]
- JumpCrisscross 2y ago> I don't know what you refer to with this specifically GDPR is a gating function. If you can afford the specific set of qualified lawyers (up to a ridiculous, plutocratic limit the likes of e.g. Google breach), you can legally offload the risks to an offshore server. If you're a tiny competitor, you should be beaten up by funded complaints.
- ginko 2y ago>If you can afford the specific set of qualified lawyers (up to a ridiculous, plutocratic limit the likes of e.g. Google breach), you can legally offload the risks to an offshore server. You can't. GDPR also applies to processing EU residents' PII outside of the EU.
- sensanaty 2y agoAs the other commenter that replied to you said, any data on EU citizens is subject to GDPR and has to be respected. Of course, enforcing that outside of EU borders is a different issue and one I don't think anyone expects to be feasible, but if you're operating within EU borders and have the data of EU citizens, you must comply with GDPR. There's a reason more and more companies are opening up EU-hosted databases.
- JumpCrisscross 2y ago> if you're operating within EU borders and have the data of EU citizens, you must comply with GDPR Right. There are plenty of foundation model companies in the US and China who would be fine training on European data without operating there. (Or doing it and paying a fine after acquisition.) It's an issue Mistral, for example, has complained about.
- amarcheschi 2y agoDon't agree entirely, at least in italy you can tell chatgpt to not use your chats to train other models. Well, it's still going to be using memory if you tell it something, but whatever info you give theoretically should remain there and not be used afterwards
- Sammi 2y agoYou made a claim but didn't backed it with an argument. How is banning corporate hoarding of user data similar to nuclear disarmament?
- JumpCrisscross 2y ago> How is banning corporate hoarding of user data similar to nuclear disarmament? Nukes have clear downsides, ones one doesn't need a protractor or regression to prove. Our estimates of the costs of data breaches remain statistical.
- Sammi 2y agoI read two more claims and but I can't parse out what your arguments for these new claims are. I just don't have enough to go by to even evaluate your original claim that nukes and data hoarding are similar. So I'm reduced to asking again: How is banning corporate hoarding of user data similar to nuclear disarmament?
- kasey_junk 2y agoThe argument is it’s infeasible. If user data in models is valuable corporations will move to legal regimes where it is allowed. Their models will get better and out compete the models made in regimes that do not allow it. Governments (probably rightly) view ai technology as strategic so will build legal regimes that improve ai. This means that they will have power over the ones that don’t. The last 50 years have shown pretty clearly that nuclear disarmament was a strategic mistake for regimes that did it so they won’t make the same mistake with ai.
- Sammi 2y ago> If user data in models is valuable corporations will move to legal regimes where it is allowed. So lets take a concrete example. Let's imagine Facebook moves out of the EU in order to skirt EU law. How do they now operate in the EU? How do they make any money from the EU users? If the EU has neighbors who have nukes, then that is a threat to the EU, and the EU needs their own nukes for deterrence. This far I follow. If the EU has neighbors who have lax data privacy laws, then that is their problem - it's not a problem in the EU because they can be barred from running businesses in the EU. Can they store the data from EU users who visit their online services? Sure. But they will have to offer free services to entice EU users to visit, because they can be blocked from running business in the EU. I don't see the business model for keeping this up.
- sensanaty 2y ago> Especially with LLMs on the horizon, this would be tantamount to unilateral nuclear disarmament. We should also be hoping for unilateral nuclear disarmament (I get your point on the infeasability though), but I don't see the parallels here. LLMs don't need personal data to work (I'd even imagine such data to be better off left out of the training data anyways, caveat for celebrities), and regardless of everything else whether the AI hypesters are to be believed about how world-changing AI/LLMs will be remains to be seen. Also, as the OP article suggests, we can and are doing something about it. Things aren't perfect yet, but GDPR itself has already made huge waves and have made things better. From how I interpret this ruling, the dark pattern cookie banners are being scrutinized and are being put under the knife, so there's some hope that things will soon improve on that front. > I have advocated for privacy issues for a short while. "Data is radioactive" is the "defund the police" of our movement. Except we can already see a shift in the masses and their opinions here. People are becoming cognizant of the sheer amount of data all these tech companies harvest on them. I am consistently getting more and more of my non-technical-in-any-capacity friends asking me how to safeguard their data better, so I'm quite hopeful we're going to get there. All we need is to actually fucking hurt the FAANGs and their ilk. Cut the head off the snake and all that, if we actually hurt Meta as we should've a million times by now, then all the smaller players will automatically fall in line for fear of a similar world of hurt.
- falcor84 2y agoWhat do you mean? Why do LLMs need user data to operate? On a side note, I also don't understand your comparison to "defund the police" - were there any places that fully applied it and demonstrated that it "fails in practice".
- JumpCrisscross 2y ago> Why do LLMs need user data to operate? Training data? > I also don't understand your comparison to "defund the police" - were there any places that fully applied it and demonstrated that it "fails in practice" It's a famous example where a minority overreacting in a presentable way set the entire movement back.
- lurking_swe 2y agoon that note, shouldn’t we ask people to CONSENT to having their data trained on? And when i say consent i mean asking them directly, not hidden in some terms of service. That’s just slimy…like a used car salesman lol. Why is it okay for companies to just vacuum up all user data without 90% of users knowing it’s happening ? Or shall the “stealing” of knowledge and creative works without consent continue?
- jeroenhd 2y agoLLMs need too much data to ethically source their data sets. That's why they rely on aggressive scraping, user-provided prompts, and of course straight-up piracy to fill their datasets. Outcry made Adobe and other such companies put (opt-out) user controls for gathering training data, but writers, especially writers on the internet, are usually ignored. I've seen even the angriest "AI is stealing my art if you use Dall-E you're a bad person" people use ChatGPT, because they don't seem to consider writing to be art or expression as much as they do their own works. Textual data just doesn't seem to be valued, and as a result data scrapers often don't care about annoyances such as "ethics" or "consent" when it comes to gathering training data.
- 2y ago