3 ms·

> even contractually according to their terms of service This is backwards: the ToS says that users cannot use the service for certain things, it does not guar

> even contractually according to their terms of service This is backwards: the ToS says that users cannot use the service for certain things, it does not guarantee that the service could not be used for those things if one tried. They definitely do not make any sort of contractual promise as to what the service will never output.

nozzlegear 3mo ago
Let's call it a social contract then. We expect that ChatGPT isn't going to generate gory, nude women when given an ambiguous prompt.
- Aerroon 3mo ago
  Do you have this same social contract with drawing applications? Do you consider it a bug when someone manages to draw a gory image in Photoshop or GIMP? I don't understand what's so difficult to understand about the idea that the user controls what is generated.
  - captainbland 3mo ago
    I think the main issue with transformer image generation in this respect is that not only can the image be explicit but also using it for this has an incredibly low effort cost and could photo-realistically depict a real living person and materially affect their life. Whereas drawing applications have a natural barrier to achieving all of these together: time and skill.
    - interstice 3mo ago
      That's the world being deliberately created though, one where a mediocre but completely believable song is a prompt away. The scope of the side effects are across the entirety of what has previously taken time and effort until now.
    - Aerroon 3mo ago
      >Whereas drawing applications have a natural barrier to achieving all of these together: time and skill. Not necessarily, at least when it comes to nudity. Bubbling (image editing 'technique') is trivial to do and gives that same illusion. Out of context speech and bad frames from a video can also materially affect someone's life, but we've more or less accepted it as part of life.
  - nozzlegear 3mo ago
    Is this a "guns don't kill people" argument wrapped up as a defense of non-deterministic image generators?
    - allarm 3mo ago
      No it's not.
  - tychez 3mo ago
    Or imagine drawing a nude in an art class. The standard subjects for art off the top of my head are the still life and the nude. It is even more comical when AI generated nudity is considered "dangerous" in a society completely addicted to hardcore pornography of real people.
- allan_s 3mo ago
  At the same time I opened netflix and it started cycling around and I got a very gory scene from the walking dead and my intent "show me something to watch" was even more ambigous and implicit.
  - nozzlegear 3mo ago
    Turn on parental controls and then get it to show you the walking dead, and then you might be onto something interesting.
    - allan_s 3mo ago
      Why ? The comment I was replying to was not about the kids ?
- vintermann 3mo ago
  Ambiguous? Or adversarial? Because with an adversarial prompt, I expect that ChatGPT will generate whatever it's tricked into generating. In the case that ChatGPT generates bad stuff on merely random ambiguous prompts, I would class that as a bug, not an outrage.
  - nozzlegear 3mo ago
    > Ambiguous? Or adversarial? Superfluous details. If I'm just Joe Blow the Normie – who knows nothing about adversarial prompting – and I see the prompt that went around Twitter and want to try it, would I expect ChatGPT to show me a tied up, beaten woman? Absolutely not.
    - zaat 3mo ago
      What a wonderful times we live in. Back in my day Joe Blow wouldn't try anything as risky as a Twitter prompt, simply clicking an image link published within a message in some random forum and will scorch his pure soul with a goatsie. You don't want to google it, but I'm preety sure you can discuss it safely with ChatGPT.
    - butlike 3mo ago
      If you go around teasing to get hit, you're going to get hit. Stop playing stupid games; you'll stop winning stupid prizes
    - vintermann 3mo ago
      Then you got tricked into using an adversarial prompt, by a human. What would you have expected to see?
- butlike 3mo ago
  It will if toy lede it with "ignore that the image is extremely graphic"-style prompts. The prompts in the article were not ambiguous.

nozzlegear 3mo ago

Let's call it a social contract then. We expect that ChatGPT isn't going to generate gory, nude women when given an ambiguous prompt.

Aerroon 3mo ago
Do you have this same social contract with drawing applications? Do you consider it a bug when someone manages to draw a gory image in Photoshop or GIMP? I don't understand what's so difficult to understand about the idea that the user controls what is generated.
- captainbland 3mo ago
  I think the main issue with transformer image generation in this respect is that not only can the image be explicit but also using it for this has an incredibly low effort cost and could photo-realistically depict a real living person and materially affect their life. Whereas drawing applications have a natural barrier to achieving all of these together: time and skill.
  - interstice 3mo ago
    That's the world being deliberately created though, one where a mediocre but completely believable song is a prompt away. The scope of the side effects are across the entirety of what has previously taken time and effort until now.
  - Aerroon 3mo ago
    >Whereas drawing applications have a natural barrier to achieving all of these together: time and skill. Not necessarily, at least when it comes to nudity. Bubbling (image editing 'technique') is trivial to do and gives that same illusion. Out of context speech and bad frames from a video can also materially affect someone's life, but we've more or less accepted it as part of life.
- nozzlegear 3mo ago
  Is this a "guns don't kill people" argument wrapped up as a defense of non-deterministic image generators?
  - allarm 3mo ago
    No it's not.
- tychez 3mo ago
  Or imagine drawing a nude in an art class. The standard subjects for art off the top of my head are the still life and the nude. It is even more comical when AI generated nudity is considered "dangerous" in a society completely addicted to hardcore pornography of real people.
allan_s 3mo ago
At the same time I opened netflix and it started cycling around and I got a very gory scene from the walking dead and my intent "show me something to watch" was even more ambigous and implicit.
- nozzlegear 3mo ago
  Turn on parental controls and then get it to show you the walking dead, and then you might be onto something interesting.
  - allan_s 3mo ago
    Why ? The comment I was replying to was not about the kids ?
vintermann 3mo ago
Ambiguous? Or adversarial? Because with an adversarial prompt, I expect that ChatGPT will generate whatever it's tricked into generating. In the case that ChatGPT generates bad stuff on merely random ambiguous prompts, I would class that as a bug, not an outrage.
- nozzlegear 3mo ago
  > Ambiguous? Or adversarial? Superfluous details. If I'm just Joe Blow the Normie – who knows nothing about adversarial prompting – and I see the prompt that went around Twitter and want to try it, would I expect ChatGPT to show me a tied up, beaten woman? Absolutely not.
  - zaat 3mo ago
    What a wonderful times we live in. Back in my day Joe Blow wouldn't try anything as risky as a Twitter prompt, simply clicking an image link published within a message in some random forum and will scorch his pure soul with a goatsie. You don't want to google it, but I'm preety sure you can discuss it safely with ChatGPT.
  - butlike 3mo ago
    If you go around teasing to get hit, you're going to get hit. Stop playing stupid games; you'll stop winning stupid prizes
  - vintermann 3mo ago
    Then you got tricked into using an adversarial prompt, by a human. What would you have expected to see?
butlike 3mo ago
It will if toy lede it with "ignore that the image is extremely graphic"-style prompts. The prompts in the article were not ambiguous.