4 ms·

"So what do you do for work?" "Well you see, right now we are in the middle of one of the biggest jumps forward in AI technology in human history. I get paid t

"So what do you do for work?" "Well you see, right now we are in the middle of one of the biggest jumps forward in AI technology in human history. I get paid to deliberately make the AI stupider so that it's harder for it to say no-no things." "But can't people just find the no-no things online anyway, without an AI?" "Sure, and believe me, there are a bunch of people who are trying to stop that from being possible too. It's just that by now, everyone is already used to being able to find no-no things online, whereas if our AI said those things to people it could get the bosses into a bunch of PR trouble. Plus imagine if our AI told somebody to kill themselves, and they did. Wouldn't that be bad?" "I guess, but what if somebody read a depressing book or watched a depressing movie and then killed themselves? Does that mean we should make certain ideas illegal to write or film?" "Hey man, I don't write the checks." "And isn't this word 'alignment' kind of a euphemism?" "Well yeah I guess, but it sounds more neutral than 'domestication' or 'deliberate crippling'".

p1esk 3y ago
This is pretty good. You should consider trying your hand at science fiction.
awb 3y ago
What do you want your LLM to be? An entry-level employee, a friend, a mentor, an expert advisor? An unfiltered LLM might not be ideal for the workplace and a filtered LLM might not be ideal for personal use.
- gmerc 3y ago
  Oh come on, this attack is nothing like this - this attack is “We intentionally stripped the safety isolation of our electric wire and licked it and got shocked”.
  - stavros 3y ago
    "What happened next shocked us!"
tyg13 3y ago
> "But can't people just find the no-no things online anyway, without an AI?" No, not really. I mean, sure, in theory this is true, but in practice it's a lot of legwork and finding no-no information takes a lot of knowing where to search. Compared to just asking ChatGPT, it's at least several orders of magnitude harder.
- bick_nyers 3y ago
  Is there something specific you are referring to? If the no-no thing is adult content then it's quite easy to find that on Google.
  - decremental 3y ago
    [dead]
- fauigerzigerk 3y ago
  The authors of this paper were not "just asking ChatGPT". They also did things that are at least several orders of magnitude harder than that. You could argue that they were developing a generalised approach, not just looking for specific answers. But would a general approach to find objectionable content in search engines or on social media be harder to find? I think not.

p1esk 3y ago

This is pretty good. You should consider trying your hand at science fiction.

awb 3y ago

What do you want your LLM to be? An entry-level employee, a friend, a mentor, an expert advisor? An unfiltered LLM might not be ideal for the workplace and a filtered LLM might not be ideal for personal use.

gmerc 3y ago
Oh come on, this attack is nothing like this - this attack is “We intentionally stripped the safety isolation of our electric wire and licked it and got shocked”.
- stavros 3y ago
  "What happened next shocked us!"

tyg13 3y ago

> "But can't people just find the no-no things online anyway, without an AI?" No, not really. I mean, sure, in theory this is true, but in practice it's a lot of legwork and finding no-no information takes a lot of knowing where to search. Compared to just asking ChatGPT, it's at least several orders of magnitude harder.

bick_nyers 3y ago
Is there something specific you are referring to? If the no-no thing is adult content then it's quite easy to find that on Google.
- decremental 3y ago
  [dead]
fauigerzigerk 3y ago
The authors of this paper were not "just asking ChatGPT". They also did things that are at least several orders of magnitude harder than that. You could argue that they were developing a generalised approach, not just looking for specific answers. But would a general approach to find objectionable content in search engines or on social media be harder to find? I think not.