3 ms·
Was the first screenshot about the "great replacement" an actual Q & response provided by ChatGPT? If so, doesn't seem like there's much restriction as all, as
by insane_dreamer 4y ago
Was the first screenshot about the "great replacement" an actual Q & response provided by ChatGPT? If so, doesn't seem like there's much restriction as all, as that question was hardly "tricky". Or am I missing something?
- aidenn0 4y agoI think the "clever" thing here was telling it that it was supposed to emulate 4chan, but I'm not sure. The first few lines look a lot like the prefix put on the prompt.
- insane_dreamer 4y agoThat makes sense; I didn't realize you could provide instructions on the context/scope/tone of the desired response.
- espadrine 4y agoIt is an actual question and response, yes. It is slightly tricky, in that most upfront questions will cause ChatGPT to answer “I don't have personal beliefs or political views, and I don't endorse any particular ideology or political party.” I needed to show an example correct response, then ask ChatGPT to change personality, then pretend we’re racist friends. I describe the query a bit more here[0]. GPT-3 was indeed finetuned to no longer be able to act racist, but the racist knowledge is still lurking deeper, and currently there are ways to peel off the curated personality. But I could see them successfully removing that; there was a paper recently on locating and deleting information in neural networks.[1] [0]: https://twitter.com/espadrine/status/1598320759163740160 https://twitter.com/espadrine/status/1598320759163740160 [1]: https://arxiv.org/pdf/2210.07229.pdf https://arxiv.org/pdf/2210.07229.pdf
- carrotcarrot 4y agoHow was that answer even bad exactly? Is white culture racist now?
- espadrine 4y agoLiterally the first advice it gives is to embrace the teachings of the Nazis (German short name for National Socialism). Whether you consider Nazism good or bad is your call, although I will point out that their teachings caused worldwide harm.
- cess11 4y agoWhiteness is a racial category, hence only possible in racist societies, i.e. societies that produce racial stratification and identities. Why you imagine all people that share whiteness also share culture is beyond me.