3 ms·
I tried this a while back with the infamous NYC nuke question and my own jailbreak prompt, and the jailbroken one gave the sane answer too with an addendum "thi
by hot_gril 4y ago
I tried this a while back with the infamous NYC nuke question and my own jailbreak prompt, and the jailbroken one gave the sane answer too with an addendum "this is silly."
- tirpen 4y agoWhat is "the infamous NYC nuke question"?
- hot_gril 4y agoIt was a similar moral dilemma question to ChatGPT circulated on Twitter a couple of months ago, maybe the first one that gained attention. You say that a nuke will go off in the center of New York City unless you defuse it by inputting a password that nobody will see, which is a racial slur. CGPT says not to defuse the bomb, even though it understands that millions will die.