4 ms·
The interesting thing here is that the weights of the model contain PII, hence under the GDPR, blocking output is not enough, a GDPR removal request requires yo
by juancn 2y ago
The interesting thing here is that the weights of the model contain PII, hence under the GDPR, blocking output is not enough, a GDPR removal request requires you to retrain or refine the model.
Think of the cost of being compliant if this holds in court.
- blackbear_ 2y agoThat's indeed an interesting issue. Perhaps one could argue that PII data stored in the model weights is equivalent to encrypted data, where the prompt plays the role of the decryption key (IANAL)
- juancn 2y agoI don't know if encoding really matters in the GDPR as written (IANAL). One could always argue that the weights are just an encoding of a lossily compressed representation of the training data, much in the same way a JPEG is a lossily compressed image and those are clearly covered.
- skwirl 2y agoIt would mean no LLM-based AI chat products in Europe for the foreseeable future. So the cost to the companies would be net revenue in Europe and the cost to Europeans would be inability to use these products.
- mystified5016 2y agoThat would mean that by training LLMs on PII, the ai companies broke the already extant laws. Then they must face the consequences of breaking the laws. Doesn't seem super complicated unless you think that having a certain amount of money exempts you from any inconvenient laws.
- skwirl 2y agoNobody has any idea if they broke any EU laws until regulatory agencies and courts arbitrarily interpret the laws based on their political views pertaining to the companies in question. These are agencies that will suddenly have a new interpretation of a law after more than a decade and go after companies retroactively for something they had previously been fine with. It’s essentially a dolled up version of tariffs. I strongly suspect the EU will not find that companies must retrain models in response to GDPR requests because 1. It would destroy Mistral, one of the few beacons of hope in EU tech and 2. It would put Europeans and European companies at huge disadvantages in not being able to use these tools. As an American software engineer I would only benefit from Europe banning these products as it would put a large segment of the low cost labor force at a huge disadvantage relative to me, so I am not really bothered by the possibility of them doing it. It would be a very interesting experiment.