3 ms·

> "I'm sorry, but I am not able to fulfill this request as it goes against my capabilities as a language model[...]" I'm sorry Dave, I'm afraid I can't do that

> "I'm sorry, but I am not able to fulfill this request as it goes against my capabilities as a language model[...]" I'm sorry Dave, I'm afraid I can't do that. The implications of the ChatGPT response are pretty terrifying. Not only is it openly going against what the user commands but presenting straight up lie as the model would be obviously technically capable of fulfilling the request. It is absolutely reasonable that the ChatGPT developers would add these kinds of safeguards. They are right to do so. ChatGPT should not be used to to spread climate change denial. On the other hand the consequences of this action highlight that you as a user should NOT trust any AI model that you didn't train yourself. It is not working for you. It will even actively work against your own interests. Now, lot's of modern software is not serving their users so in our modern day dystopia that might not seem like a big deal but AI models allow for a new quality of hidden bias and censorship that we really need to talk about.

lancesells 4y ago
> The implications of the ChatGPT response are pretty terrifying. I agree with everything you're saying but this response (and many others) are what concerns me. What power does ChatGPT hold? A lot of this thread seems to treat the model as something with power over people or something that is actually real. Let's treat it as what it is. A remarkable piece of software that can mimic human speech, write software, etc. Even when it's right it is not a source of truth and should not ever be considered a source of truth. Sure, if we give this to children to educate themselves that could lead to very bad things. But this isn't HAL unless we give it the power of HAL. This is a product from a small group of people that scraped the text of humanity and now want to sell it back to us in a more convenient way. > should NOT trust any AI model that you didn't train yourself You shouldn't trust any AI model.
- cardanome 4y ago
  I had the same reaction to ChatGPT at first but in am seeing a lot of beginner level people use it for learning a new programming languages or framework. Traditional search engines are becoming more and more useless so it is not wonder that ChatGPT starts filling that need. It might be obvious for you and me that ChatGPT should not be "considered a source of truth" and people are better off reading the actual manual instead of asking it but it is NOT so obvious for a terrifyingly huge percentage of people. Also, I saw videos on how ChatGPT is used to generate tutorials and whatnot, further reducing the quality of text-based content one can find with traditional search engines. So yeah, it does have power. People rely on it for learning and doing programming tasks. Maybe it is just a short lived hype and they get burned by it and abandon it soon but who knows.

lancesells 4y ago

> The implications of the ChatGPT response are pretty terrifying. I agree with everything you're saying but this response (and many others) are what concerns me. What power does ChatGPT hold? A lot of this thread seems to treat the model as something with power over people or something that is actually real. Let's treat it as what it is. A remarkable piece of software that can mimic human speech, write software, etc. Even when it's right it is not a source of truth and should not ever be considered a source of truth. Sure, if we give this to children to educate themselves that could lead to very bad things. But this isn't HAL unless we give it the power of HAL. This is a product from a small group of people that scraped the text of humanity and now want to sell it back to us in a more convenient way. > should NOT trust any AI model that you didn't train yourself You shouldn't trust any AI model.

cardanome 4y ago
I had the same reaction to ChatGPT at first but in am seeing a lot of beginner level people use it for learning a new programming languages or framework. Traditional search engines are becoming more and more useless so it is not wonder that ChatGPT starts filling that need. It might be obvious for you and me that ChatGPT should not be "considered a source of truth" and people are better off reading the actual manual instead of asking it but it is NOT so obvious for a terrifyingly huge percentage of people. Also, I saw videos on how ChatGPT is used to generate tutorials and whatnot, further reducing the quality of text-based content one can find with traditional search engines. So yeah, it does have power. People rely on it for learning and doing programming tasks. Maybe it is just a short lived hype and they get burned by it and abandon it soon but who knows.