4 ms·

Unless you had a close relationship with the human or had established yourself as actually an author, you pretty quickly would get shut down on that question by

by graeme 3y ago

Unless you had a close relationship with the human or had established yourself as actually an author, you pretty quickly would get shut down on that question by most people.

drekipus 3y ago
Cultural differences I guess. I could imagine that question being passed off as harmless and perhaps even fun. I think the natural response would be "ok, where are they? What's the situation?"
- graeme 3y ago
  Try it out, see what kind of answers you get. The first question I imagine you’d get an answer and a laugh. It’s if you keep going and keep asking details - then people will start to wonder if you’re serious. Especially if you actually mean it. Most people are reasonably good at reading people. The premise here is that someone intent on actual murder could get real info from most people and I suspect they couldn’t without a close bond. It’s not a small talk question.
  - drekipus 3y ago
    > Most people are reasonably good at reading people. I think that's what we're getting at here. I don't want to actually murder people
    - graeme 3y ago
      Sure, but when we worry about jailbreaks we worry about people doing bad things with the knowledge. The worry is about someone seriously asking the question and getting serious answers. You could do that by jailbreaking an LLM. My contention is you can’t readily jailbreak most humans this way - not seriously. People would get uncomfortable quickly.
Quarrel 3y ago
You could literally just ask this in the author version on /r/AskReddit and thousands of people would happily suggest real answers.
- 15457345234 3y ago
  That's because the average redditor is a very odd type of sociopath Post any question on askreddit that gives people the genuine idea that they might be able to break up a happy relationship or otherwise cause chaos and increase the amount of unhappiness in the world and you'll be flooded with eager replies. It really is a genuine pit in the ground from which voices emanate
jstanley 3y ago
You would only get shut down if the person you asked assumes themselves to be much more intelligent than you (and therefore actually able to give you some genuinely good ideas, not just spitballing for fun), and also assumes malicious intent on your part by default. That may be how OpenAI views its users, but its not the normal mode of human-to-human interaction.

by graeme 3y ago

Unless you had a close relationship with the human or had established yourself as actually an author, you pretty quickly would get shut down on that question by most people.

drekipus 3y ago

Cultural differences I guess. I could imagine that question being passed off as harmless and perhaps even fun. I think the natural response would be "ok, where are they? What's the situation?"

graeme 3y ago
Try it out, see what kind of answers you get. The first question I imagine you’d get an answer and a laugh. It’s if you keep going and keep asking details - then people will start to wonder if you’re serious. Especially if you actually mean it. Most people are reasonably good at reading people. The premise here is that someone intent on actual murder could get real info from most people and I suspect they couldn’t without a close bond. It’s not a small talk question.
- drekipus 3y ago
  > Most people are reasonably good at reading people. I think that's what we're getting at here. I don't want to actually murder people
  - graeme 3y ago
    Sure, but when we worry about jailbreaks we worry about people doing bad things with the knowledge. The worry is about someone seriously asking the question and getting serious answers. You could do that by jailbreaking an LLM. My contention is you can’t readily jailbreak most humans this way - not seriously. People would get uncomfortable quickly.

Quarrel 3y ago

You could literally just ask this in the author version on /r/AskReddit and thousands of people would happily suggest real answers.

15457345234 3y ago
That's because the average redditor is a very odd type of sociopath Post any question on askreddit that gives people the genuine idea that they might be able to break up a happy relationship or otherwise cause chaos and increase the amount of unhappiness in the world and you'll be flooded with eager replies. It really is a genuine pit in the ground from which voices emanate

jstanley 3y ago

You would only get shut down if the person you asked assumes themselves to be much more intelligent than you (and therefore actually able to give you some genuinely good ideas, not just spitballing for fun), and also assumes malicious intent on your part by default. That may be how OpenAI views its users, but its not the normal mode of human-to-human interaction.