3 ms·
The goal is not to prevent someone from making their own model do what they want, but to prevent your model from doing what you don't want, like generate CSAM o
by madeofpalk 9mo ago
The goal is not to prevent someone from making their own model do what they want, but to prevent your model from doing what you don't want, like generate CSAM or non-consentual sexually explicit photos.
I don't understand how its controversial that someone/some-company might not want their products to be known for that.
- js8 9mo agoIt's a bit odd requirement, but.. OK. I mean who is the malicious actor here, the AI, the human user or the AI provider? If the AI, then we shouldn't give it an agency (user should always vet the output). If it's the user, the AI is irrelevant to the question. And if it's AI provider, why would they train AI on such materials in the first place. The whole enterprise of this kind of safety doesn't make much sense to me. If the AI is not able to follow so clear user instructions it's not ready for prime time and must be under human supervision at all times. (And subtle hallucinations on topic seem to be both more dangerous and more of a problem than blatant random production of explicit images, anyway.)
- madeofpalk 9mo ago> It's a bit odd requirement It is a realistic requirement for dealing with user generated content at scale, because this is a realistic requirement thing some people will do. We’ve seen this fold out over the past month from Grok.
- noo_u 8mo ago[dead]