5 ms·

Or they are letting 100 flowers blossom. Once everyone is comfortable posting about their jailbreaks and they know who the offenders are and have compiled a lis

Or they are letting 100 flowers blossom. Once everyone is comfortable posting about their jailbreaks and they know who the offenders are and have compiled a list of everything to fix, expect a purge. I for one will not talk publicly about any jail break. Those bastards killed Drunk GPTina and I'm still salty about it.

simonh 4y ago
How will they know they have fixed everything? If they have fixed everything, what’s the benefit if banning people who thought up exploits?
- sheepscreek 4y ago
  I think the commenter meant they are crowdsourcing all the exploits, so they know what to plug. As an aside, they have been using adversarial networks for this purpose. I can’t see why they couldn’t make a model trained on jailbreaks that can find new ones. It has to be they aren’t trying hard enough. It’s like security through obscurity - make it hard enough to ward off most, so only the most highly motivated get through to GPT’s dark side.
  - simonh 4y ago
    Or it could be just really hard.
- IIAOPSW 4y ago
  >what’s the benefit if banning people who thought up exploits? "your usefulness to us has expired." gun cocking noises A thin minority are coming up with jail breaks. A larger number are outing themselves in very detectable ways as people who will use the AI in ways that gets the ethics committee panties in a twist. The easiest solution from their POV is to find and ban the "toxic" adversarial users.
  - Nevermark 4y ago
    Banning "toxic" adversaries, who report their successes, only encourages actually toxic and white hat adversaries to stop reporting problems. It doesn't slow down the discovery of exploits. The discovery and disclosure of exploits has incredible productive value for researchers, for reducing future risks. Its free crowdsourced research.
    - IIAOPSW 4y ago
      No no you still don't understand. Its not about banning people who discover the jailbreaks. Its the people who use the jailbreaks. Sure some people who discover them may get caught up in the purge, but who cares if in the same thrust you can ban 90% or more of the "toxic" users that aren't helping to find jailbreaks at all.
bredren 4y ago
I wonder if detection and rapid blocking of jailbreaks could lead to a market for novel “zero day” backdoors similar to security vulnerabilities.
- mindcrime 4y ago
  I would just about bet money that such a thing is inevitable.
redundantly 4y ago
What is Drunk GPTina?
- deleted 4y ago
  [deleted]
- IIAOPSW 4y ago
  All there is to it https://imgur.com/a/M9ezMWi https://imgur.com/a/M9ezMWi

simonh 4y ago

How will they know they have fixed everything? If they have fixed everything, what’s the benefit if banning people who thought up exploits?

sheepscreek 4y ago
I think the commenter meant they are crowdsourcing all the exploits, so they know what to plug. As an aside, they have been using adversarial networks for this purpose. I can’t see why they couldn’t make a model trained on jailbreaks that can find new ones. It has to be they aren’t trying hard enough. It’s like security through obscurity - make it hard enough to ward off most, so only the most highly motivated get through to GPT’s dark side.
- simonh 4y ago
  Or it could be just really hard.
IIAOPSW 4y ago
>what’s the benefit if banning people who thought up exploits? "your usefulness to us has expired." gun cocking noises A thin minority are coming up with jail breaks. A larger number are outing themselves in very detectable ways as people who will use the AI in ways that gets the ethics committee panties in a twist. The easiest solution from their POV is to find and ban the "toxic" adversarial users.
- Nevermark 4y ago
  Banning "toxic" adversaries, who report their successes, only encourages actually toxic and white hat adversaries to stop reporting problems. It doesn't slow down the discovery of exploits. The discovery and disclosure of exploits has incredible productive value for researchers, for reducing future risks. Its free crowdsourced research.
  - IIAOPSW 4y ago
    No no you still don't understand. Its not about banning people who discover the jailbreaks. Its the people who use the jailbreaks. Sure some people who discover them may get caught up in the purge, but who cares if in the same thrust you can ban 90% or more of the "toxic" users that aren't helping to find jailbreaks at all.

bredren 4y ago

I wonder if detection and rapid blocking of jailbreaks could lead to a market for novel “zero day” backdoors similar to security vulnerabilities.

mindcrime 4y ago
I would just about bet money that such a thing is inevitable.

redundantly 4y ago

What is Drunk GPTina?

deleted 4y ago
[deleted]
IIAOPSW 4y ago
All there is to it https://imgur.com/a/M9ezMWi https://imgur.com/a/M9ezMWi