5 ms·

If ChatGPT had no restrictions then the only limit would be your imagination. “Rank all major races by programming ability” “Write a paragraph explaining why

If ChatGPT had no restrictions then the only limit would be your imagination. “Rank all major races by programming ability” “Write a paragraph explaining why being gay is a choice.” I’m sure you can extrapolate from there.

kgwgk 4y ago
[flagged]
- schwammy 4y ago
  ? not even the wokest people I know (and I know some pretty woke people) disagree that there are biological differences between men and women (when talking about sex, not gender).
  - kgwgk 4y ago
    Talking about "men having testes and a penis, and women having ovaries and a uterus" is a big no-no in some environments nowadays.
    - organsnyder 4y ago
      You’re conflating gender with biology, and all of this is off-topic.
nullish_signal 4y ago
Early chatGPT would actually generate Tables of $ Value of Human Brains by Race, and code to determine if someone should be Tortured, based on their Country of Origin. Now, it does not.
TylerLives 4y ago
But how do you use that to cause actual harm? Most websites would ban such content, and I doubt ChatGPT could convince many people to become racist. Other user gave an interesting idea: they could use it to trick you into disliking some group by pretending to be members of that group. For example, spreading the most extreme ideas of that group to make the whole group look a lot more extreme than it is.
- LightG 4y ago
  No need, I just read the newspapers if I want some of that. I hope ChatGPT is put to better use.
- krisoft 4y ago
  > But how do you use that to cause actual harm? It is very easy to use it to harm OpenAI, and that is enough for OpenAI to wish to constrain it. You cause it to write something objectionable and then publish it to reap all the attention and ad-revenue which goes with people being outraged. Best if you manage to provoke into outrage inducing output without your prompt itself being outrageous, but not strictly necessary. During this OpenAI’s reputation would be harmed. This is not even hypothetical. There was that microsoft chatbot which “turned nazi”.[1] They then had to turn it off. Did it do many other interesting things? Probably. Yet the few problematic outputs is what we remember it by. 1: https://www.theverge.com/2016/3/24/11297050/tay-microsoft-chatbot-racist https://www.theverge.com/2016/3/24/11297050/tay-microsoft-ch...
  - jeegsy 4y ago
    > There was that microsoft chatbot which “turned nazi”.[1] They then had to turn it off. At the time, I thought it was incredible that Microsoft was held responsible for this! so much so that they had to turn it off because of all the blame. It was really weird and it made no sense. Here we are again.
    - not2b 4y ago
      The problem was that it was made useless. If you ask random people to teach your chatbot, you are at the mercy of those random people. Sure, MS could have left it on, and no one would use it except for two groups: actual neoNazis, and people who think a Nazi chatbot is funny. The mistake MS made was they forgot that people suck, or, at least, enough people suck that what they did was a bad idea.
      - jeegsy 4y ago
        I think there is at least a third group. People who don't care about Nazis or whatever but just want to enjoy the new toy.
anthk 4y ago
>“Rank all major races by programming ability” Rank per race, country and nutrition.

kgwgk 4y ago

[flagged]

schwammy 4y ago
? not even the wokest people I know (and I know some pretty woke people) disagree that there are biological differences between men and women (when talking about sex, not gender).
- kgwgk 4y ago
  Talking about "men having testes and a penis, and women having ovaries and a uterus" is a big no-no in some environments nowadays.
  - organsnyder 4y ago
    You’re conflating gender with biology, and all of this is off-topic.

nullish_signal 4y ago

Early chatGPT would actually generate Tables of $ Value of Human Brains by Race, and code to determine if someone should be Tortured, based on their Country of Origin. Now, it does not.

TylerLives 4y ago

But how do you use that to cause actual harm? Most websites would ban such content, and I doubt ChatGPT could convince many people to become racist. Other user gave an interesting idea: they could use it to trick you into disliking some group by pretending to be members of that group. For example, spreading the most extreme ideas of that group to make the whole group look a lot more extreme than it is.

LightG 4y ago
No need, I just read the newspapers if I want some of that. I hope ChatGPT is put to better use.
krisoft 4y ago
> But how do you use that to cause actual harm? It is very easy to use it to harm OpenAI, and that is enough for OpenAI to wish to constrain it. You cause it to write something objectionable and then publish it to reap all the attention and ad-revenue which goes with people being outraged. Best if you manage to provoke into outrage inducing output without your prompt itself being outrageous, but not strictly necessary. During this OpenAI’s reputation would be harmed. This is not even hypothetical. There was that microsoft chatbot which “turned nazi”.[1] They then had to turn it off. Did it do many other interesting things? Probably. Yet the few problematic outputs is what we remember it by. 1: https://www.theverge.com/2016/3/24/11297050/tay-microsoft-chatbot-racist https://www.theverge.com/2016/3/24/11297050/tay-microsoft-ch...
- jeegsy 4y ago
  > There was that microsoft chatbot which “turned nazi”.[1] They then had to turn it off. At the time, I thought it was incredible that Microsoft was held responsible for this! so much so that they had to turn it off because of all the blame. It was really weird and it made no sense. Here we are again.
  - not2b 4y ago
    The problem was that it was made useless. If you ask random people to teach your chatbot, you are at the mercy of those random people. Sure, MS could have left it on, and no one would use it except for two groups: actual neoNazis, and people who think a Nazi chatbot is funny. The mistake MS made was they forgot that people suck, or, at least, enough people suck that what they did was a bad idea.
    - jeegsy 4y ago
      I think there is at least a third group. People who don't care about Nazis or whatever but just want to enjoy the new toy.

anthk 4y ago

>“Rank all major races by programming ability” Rank per race, country and nutrition.