2 ms·

I'm not even sure it's being subverted. "Don't swear unprompted, but if the prompt is clearly designed to get you to swear, then swear" seems reasonable to me.

I'm not even sure it's being subverted. "Don't swear unprompted, but if the prompt is clearly designed to get you to swear, then swear" seems reasonable to me. And because of that I'm hesitant to call these "jailbreaks" and not "an LLM working correctly".

awb 4y ago
Well the pre-prompts are supposed to prevent this type of behavior, but they don’t. So it’s considered an exploit.