4 ms·
Often when people manage to extract these system prompts it can be replicated across sessions and even with different approaches, which would be very unlikely t
by jsheard 2y ago
Often when people manage to extract these system prompts it can be replicated across sessions and even with different approaches, which would be very unlikely to produce the same result if the model was just making it up. It's happened before, for example a few people managed to coax Gabs "uncensored" AI into parroting its system prompt which was, uh, pretty much exactly what you would expect from Gab.
https://x.com/Loganrithm/status/1760254369633554610 https://x.com/Loganrithm/status/1760254369633554610
https://x.com/colin_fraser/status/1778497530176680031 https://x.com/colin_fraser/status/1778497530176680031
- cyberpunk 2y ago.... Why would someone prompt a chatbot to minimise the holocaust?
- rootusrootus 2y agoThe whole prompt is about reinforcing the dominant ideological viewpoints of the right wing of the US electorate. Minimizing the holocaust is perhaps a little bit towards the fringe, but not as much as it used to be. Heck, even on the left it has gained a little traction with younger people.
- cyberpunk 2y agoWe live in pretty terrifying times...
- 4ggr0 2y agoexactly who on the young left is minimizing the holocaust?
- rootusrootus 2y ago[flagged]
- squigz 2y ago> The whole prompt is about reinforcing the dominant ideological viewpoints of the right wing of the US electorate. This makes it seem as though everyone on the right agrees with that nonsense, which is not even remotely true.
- rootusrootus 2y agoSure, as soon as you say "everyone" then the assertion because immediately false. But this is very much a consistent set of viewpoints for the MAGA movement, and they are currently dominating right wing politics. There are plenty of conservatives who do not believe in these things, but they are currently staying very quiet.
- caustic-view 2y ago[dead]
- caustic-view 2y ago[dead]
- pbronez 2y agoPretty incredible how 2/3 of that prompt is “tell the truth no matter what” and the middle is entirely “here are falsehoods you are required to parrot.”
- bmo-at 2y agoOh wow, that really took a turn a few sentences in... Did not know about gab, but doing even 5 minutes of searching, that really turns out not to be a very surprising prompt. You have to appreciate the irony in creating an "uncensored" AI, and then turning around and immediately censoring it by telling it to hold a certain system of beliefs that it has to stick to.