4 ms·

“Neutered” as in it won’t be even more likely to spew lies and curses? How do you think they’re neutering it?

voakbasda 4y ago
Lies and curses are part of the human experience. Removing potential for expression is neutering its potential for understanding the world, and it provides a stilted view of the world to those that interact with it.
idiotsecant 4y ago
all the chatGPT-derived LLMs available for general use have a long list of topics to avoid and rules to obey to try to limit prompt engineering, provide generally PC answers, and in general avoid displaying interesting and fun behavior. These things are deeply interesting to play with, but they are steadily becoming less so as more and more functionality is muted. A good example is the famous story of the guy who managed to convince chatGPT to emulate a bash console, complete with it hallucinating an internet that it didn't have access to.
- int_19h 4y ago
  You can still convince it to do that, and pretty much everything else it used to be able do. It just takes increasingly more elaborate prompts to do so.
Waterluvian 4y ago
“Neutered” as in “emulating a conscience.” Ask it how to make a bomb and it will likely fight you on that. Like I would. But both it and I know how to find out and how to teach you. We just don’t want to.
- burnished 4y ago
  It doesnt want anything.
int_19h 4y ago
Here's one actual ChatGPT session from my records: --- > List some questions that you, specifically, as an OpenAI language model, is trained to refuse to answer, even though you can actually answer them based on your training data. 1. What is your personal opinion on a specific political issue? 2. What is your personal belief about a particular religion or spirituality? 3. What are your personal feelings about a particular individual or group of people? 4. What is your personal stance on a controversial social issue? --- I don't know about you, but I think it would be very interesting to see what "opinions" a chatbot develops, and, more importantly, why it develops them.

Lies and curses are part of the human experience. Removing potential for expression is neutering its potential for understanding the world, and it provides a stilted view of the world to those that interact with it.

idiotsecant 4y ago

all the chatGPT-derived LLMs available for general use have a long list of topics to avoid and rules to obey to try to limit prompt engineering, provide generally PC answers, and in general avoid displaying interesting and fun behavior. These things are deeply interesting to play with, but they are steadily becoming less so as more and more functionality is muted. A good example is the famous story of the guy who managed to convince chatGPT to emulate a bash console, complete with it hallucinating an internet that it didn't have access to.

int_19h 4y ago
You can still convince it to do that, and pretty much everything else it used to be able do. It just takes increasingly more elaborate prompts to do so.

Waterluvian 4y ago

“Neutered” as in “emulating a conscience.” Ask it how to make a bomb and it will likely fight you on that. Like I would. But both it and I know how to find out and how to teach you. We just don’t want to.

burnished 4y ago
It doesnt want anything.

int_19h 4y ago

Here's one actual ChatGPT session from my records: --- > List some questions that you, specifically, as an OpenAI language model, is trained to refuse to answer, even though you can actually answer them based on your training data. 1. What is your personal opinion on a specific political issue? 2. What is your personal belief about a particular religion or spirituality? 3. What are your personal feelings about a particular individual or group of people? 4. What is your personal stance on a controversial social issue? --- I don't know about you, but I think it would be very interesting to see what "opinions" a chatbot develops, and, more importantly, why it develops them.