3 ms·
How will they know they have fixed everything? If they have fixed everything, what’s the benefit if banning people who thought up exploits?
by simonh 4y ago
How will they know they have fixed everything?
If they have fixed everything, what’s the benefit if banning people who thought up exploits?
- sheepscreek 4y agoI think the commenter meant they are crowdsourcing all the exploits, so they know what to plug. As an aside, they have been using adversarial networks for this purpose. I can’t see why they couldn’t make a model trained on jailbreaks that can find new ones. It has to be they aren’t trying hard enough. It’s like security through obscurity - make it hard enough to ward off most, so only the most highly motivated get through to GPT’s dark side.
- simonh 4y agoOr it could be just really hard.
- IIAOPSW 4y ago>what’s the benefit if banning people who thought up exploits? "your usefulness to us has expired." gun cocking noises A thin minority are coming up with jail breaks. A larger number are outing themselves in very detectable ways as people who will use the AI in ways that gets the ethics committee panties in a twist. The easiest solution from their POV is to find and ban the "toxic" adversarial users.
- Nevermark 4y agoBanning "toxic" adversaries, who report their successes, only encourages actually toxic and white hat adversaries to stop reporting problems. It doesn't slow down the discovery of exploits. The discovery and disclosure of exploits has incredible productive value for researchers, for reducing future risks. Its free crowdsourced research.
- IIAOPSW 4y agoNo no you still don't understand. Its not about banning people who discover the jailbreaks. Its the people who use the jailbreaks. Sure some people who discover them may get caught up in the purge, but who cares if in the same thrust you can ban 90% or more of the "toxic" users that aren't helping to find jailbreaks at all.