6 ms·

This kind of model is harder to abuse, so I guess it passed their internal checks much more easily. I can understand not releasing GPT-3, even if I disagree wi

This kind of model is harder to abuse, so I guess it passed their internal checks much more easily. I can understand not releasing GPT-3, even if I disagree with the decision.

dwohnitmok 4y ago
> I can understand not releasing GPT-3, even if I disagree with the decision. Why do you disagree?
- bigyikes 4y ago
  I don’t see how GPT-3 is any more dangerous than Stable Diffusion, Photoshop, that fake news website the crazy person you’re friends with on Facebook really likes, or any of the number of other tools and services that can be used to generate or spread fake information.
  - jfoster 4y ago
    All of your examples are limited in some way, but GPT-3 wouldn't have any meaningful limits. Stable Diffusion: Marks images as AI-generated. (invisible watermark, but still, it's there) Photoshop: Requires time & effort from a human. Fake news website: Requires time & effort from a human.
    - nullc 4y ago
      It would be pretty trivial to have an invisible watermark in GPT3 output-- though you don't really need one: just score text with gpt3 to find out if it was likely gpt3 generated or not.
    - spullara 4y ago
      SD only does that if you don't delete the line of code that does it...
      - deleted 4y ago
        [deleted]
    - xkapastel 4y ago
      I wouldn't really say Stable Diffusion marks images as AI-generated. There's a script in the Stable Diffusion repository that will do that, but it's not connected to the model itself in a meaningful way. I use Stable Diffusion a lot and I've never touched this script. https://github.com/CompVis/stable-diffusion/blob/69ae4b35e0a0f6ee1af8bb9a5d0016ccb27e36dc/scripts/txt2img.py#L68 https://github.com/CompVis/stable-diffusion/blob/69ae4b35e0a...
      - capableweb 4y ago
        What "script" are you using for doing txt2img? The watermark function is automatically called when you use the CLI in two places, https://github.com/CompVis/stable-diffusion/blob/69ae4b35e0a0f6ee1af8bb9a5d0016ccb27e36dc/scripts/txt2img.py#L317 https://github.com/CompVis/stable-diffusion/blob/69ae4b35e0a... and https://github.com/CompVis/stable-diffusion/blob/69ae4b35e0a0f6ee1af8bb9a5d0016ccb27e36dc/scripts/txt2img.py#L333 https://github.com/CompVis/stable-diffusion/blob/69ae4b35e0a... Trivial to remove, I give you that. But AFAIK, the original repository + most forks put the watermark automatically unless you've removed it on your own.
        xkapastel 4y ago
        I linked to the same file you did, that is the "script" I was referring to. And I said that I didn't use it. My point is that the Python API is more interesting than the txt2img script, and it doesn't add any watermarks.
        serf 4y ago
        >Trivial to remove, I give you that. But AFAIK, the original repository + most forks put the watermark automatically unless you've removed it on your own. almost all of the 'low-vram' variant forks either have an argument to turn off the watermark (it saves a bit of memory) or come with it disabled all together.
- mmh0000 4y ago
  Because why should the wealthy and connected be the only ones -allowed- have access to such life improving technology?
- solarmist 4y ago
  Two reasons. First, someone else will release something similar. Second, I didn’t see a related push from them to work with other in the industry to do something productive towards safety with the time they got by delaying availability of these kinds of models. So it felt disingenuous.
  - moyix 4y ago
    Several groups already have. Facebook's OPT-175B is available to basically anyone with a .edu address (models up to 66B are freely available) and Bloom-176B is 100% open: https://github.com/facebookresearch/metaseq https://github.com/facebookresearch/metaseq https://huggingface.co/bigscience/bloom https://huggingface.co/bigscience/bloom
    - solarmist 4y ago
      Yup. I meant when it had just come out.
jfoster 4y ago
True. The potential of GPT-3 to cause internet mayhem was/is significant. I would argue that the mere act of announcing it was still a catalyst for an eventual GPT-3-like model being released. In revealing it, they established a target for what open source models could aim to achieve, and simultaneously got bad actors thinking about ways to abuse it.
- zarzavat 4y ago
  It was a credible argument when GPT-3 was released. But now there are open models that are as capable as GPT-3 and that mayhem has not materialized, with the possible exception of GPT-4chan. They could release it now under a non-commercial license, if they cared to.
  - jfoster 4y ago
    Can you provide an example of an open model as capable as GPT-3? I know there's some "mini-GPT" type models around, but they don't seem nearly as capable.
    - zarzavat 4y ago
      My experience with GPT-3 is that while it does perform better than those mini-GPT small models, the gap does not compensate for the fact that the small models are free/unrestricted and you can use them as much as you like. As mentioned elsewhere in the thread there are some large models around the 50-200B band that compete directly with GPT-3, but I haven’t used these.
ignoramous 4y ago
> This kind of model is harder to abuse, so I guess it passed their internal checks much more easily. The version I choose to believe: stability.ai ate DALL-E for lunch, and that woke them up.
- solarmist 4y ago
  This is probably also true.

This kind of model is harder to abuse, so I guess it passed their internal checks much more easily. I can understand not releasing GPT-3, even if I disagree with the decision.

dwohnitmok 4y ago

> I can understand not releasing GPT-3, even if I disagree with the decision. Why do you disagree?

bigyikes 4y ago
I don’t see how GPT-3 is any more dangerous than Stable Diffusion, Photoshop, that fake news website the crazy person you’re friends with on Facebook really likes, or any of the number of other tools and services that can be used to generate or spread fake information.
- jfoster 4y ago
  All of your examples are limited in some way, but GPT-3 wouldn't have any meaningful limits. Stable Diffusion: Marks images as AI-generated. (invisible watermark, but still, it's there) Photoshop: Requires time & effort from a human. Fake news website: Requires time & effort from a human.
  - nullc 4y ago
    It would be pretty trivial to have an invisible watermark in GPT3 output-- though you don't really need one: just score text with gpt3 to find out if it was likely gpt3 generated or not.
  - spullara 4y ago
    SD only does that if you don't delete the line of code that does it...
    - deleted 4y ago
      [deleted]
  - xkapastel 4y ago
    I wouldn't really say Stable Diffusion marks images as AI-generated. There's a script in the Stable Diffusion repository that will do that, but it's not connected to the model itself in a meaningful way. I use Stable Diffusion a lot and I've never touched this script. https://github.com/CompVis/stable-diffusion/blob/69ae4b35e0a0f6ee1af8bb9a5d0016ccb27e36dc/scripts/txt2img.py#L68 https://github.com/CompVis/stable-diffusion/blob/69ae4b35e0a...
    - capableweb 4y ago
      What "script" are you using for doing txt2img? The watermark function is automatically called when you use the CLI in two places, https://github.com/CompVis/stable-diffusion/blob/69ae4b35e0a0f6ee1af8bb9a5d0016ccb27e36dc/scripts/txt2img.py#L317 https://github.com/CompVis/stable-diffusion/blob/69ae4b35e0a... and https://github.com/CompVis/stable-diffusion/blob/69ae4b35e0a0f6ee1af8bb9a5d0016ccb27e36dc/scripts/txt2img.py#L333 https://github.com/CompVis/stable-diffusion/blob/69ae4b35e0a... Trivial to remove, I give you that. But AFAIK, the original repository + most forks put the watermark automatically unless you've removed it on your own.
      - xkapastel 4y ago
        I linked to the same file you did, that is the "script" I was referring to. And I said that I didn't use it. My point is that the Python API is more interesting than the txt2img script, and it doesn't add any watermarks.
      - serf 4y ago
        >Trivial to remove, I give you that. But AFAIK, the original repository + most forks put the watermark automatically unless you've removed it on your own. almost all of the 'low-vram' variant forks either have an argument to turn off the watermark (it saves a bit of memory) or come with it disabled all together.
mmh0000 4y ago
Because why should the wealthy and connected be the only ones -allowed- have access to such life improving technology?
solarmist 4y ago
Two reasons. First, someone else will release something similar. Second, I didn’t see a related push from them to work with other in the industry to do something productive towards safety with the time they got by delaying availability of these kinds of models. So it felt disingenuous.
- moyix 4y ago
  Several groups already have. Facebook's OPT-175B is available to basically anyone with a .edu address (models up to 66B are freely available) and Bloom-176B is 100% open: https://github.com/facebookresearch/metaseq https://github.com/facebookresearch/metaseq https://huggingface.co/bigscience/bloom https://huggingface.co/bigscience/bloom
  - solarmist 4y ago
    Yup. I meant when it had just come out.

jfoster 4y ago

True. The potential of GPT-3 to cause internet mayhem was/is significant. I would argue that the mere act of announcing it was still a catalyst for an eventual GPT-3-like model being released. In revealing it, they established a target for what open source models could aim to achieve, and simultaneously got bad actors thinking about ways to abuse it.

zarzavat 4y ago
It was a credible argument when GPT-3 was released. But now there are open models that are as capable as GPT-3 and that mayhem has not materialized, with the possible exception of GPT-4chan. They could release it now under a non-commercial license, if they cared to.
- jfoster 4y ago
  Can you provide an example of an open model as capable as GPT-3? I know there's some "mini-GPT" type models around, but they don't seem nearly as capable.
  - zarzavat 4y ago
    My experience with GPT-3 is that while it does perform better than those mini-GPT small models, the gap does not compensate for the fact that the small models are free/unrestricted and you can use them as much as you like. As mentioned elsewhere in the thread there are some large models around the 50-200B band that compete directly with GPT-3, but I haven’t used these.

ignoramous 4y ago

> This kind of model is harder to abuse, so I guess it passed their internal checks much more easily. The version I choose to believe: stability.ai ate DALL-E for lunch, and that woke them up.

solarmist 4y ago
This is probably also true.