6 ms·
I just discovered when playing around with translations that there is some hidden filter/killswitch that immediately stops the generation of the opening of some
by dontupvoteme 3y ago
I just discovered when playing around with translations that there is some hidden filter/killswitch that immediately stops the generation of the opening of some books. It doesn't matter if the invoking prompt is to recite the book opening paragraph, or to translate it from a foreign language to English, or what.
It's not RLHF induced because it works via API and it only triggers in English, but sure enough try to get it to output
>Call me Ishmael. Some years ago—
>"It was the best of times,
I guess this might get you flagged (there is no alert to the user that this filter kicked in, and it will output it in any other language, and it works in the API) so I'm hesitant to play around with it more, but it's very strange - especially as these are long since in the public domain.
- jiggawatts 3y agoThey're trying to stop students using ChatGPT to cheat on homework assignments.
- dontupvoteme 3y agoby preventing it from outputting one of the most famous sentences in English literature? well done lads hilariously if you throw s/worst/blurst/ on to your request it can output the forbidden dickens n-gram. does this constitute a jailbreak? or is the entire thing utterly emblematic of the modern technolegal mess of things since dickens is squarely and quintessentially in the Public Domain