3 ms·

Creating a deepfake marketplace trading in celebrity and private-person identities is ... quite the choice to make, legally (and ethically) speaking.

brucethemoose2 3y ago
The models are free without a login. The only way I would characterizing it as a "marketplace," it individuals offering commissions, I guess.
- dragonwriter 3y ago
  Some are available early exclusively to paid members, and there are onsite model training and generation services, which are paid (in virtual, but can be bought for cash, currency.)
  - brucethemoose2 3y ago
    Well huggingface and tons of others offer stable diffusion training services. Google essentially hosts dreambooth with options for a subscription. Thats nothing unique. I dunno about early access.
    - dragonwriter 3y ago
      > Well huggingface and tons of others offer stable diffusion training services. Huggingface also has porn-focussed trained stable-diffusion models. [0] They also have celebrity-trained models. [1] [0] e.g., https://huggingface.co/WolfAether21/NSFW-STABLE-DIFFUSION-LORA/tree/main https://huggingface.co/WolfAether21/NSFW-STABLE-DIFFUSION-LO... [1] e.g., (yes, poor quality from the samples) https://huggingface.co/lora-library/12jenniferl https://huggingface.co/lora-library/12jenniferl
dragonwriter 3y ago
But that wasn't the choice, the choice was to create an open hub for basically everything related to Stable Diffusion, with limits for a broad range of illegal things, but without policies against things that are steps out from that because at even one step out the “well, combined with other things it could be used badly” bans everything. The highlighted bounty feature is technically accurately, but misleadingly, described. Yes, people can and do post requests for models of real celebs there, but they also post requests for fictional character models, for concept models not tied to particular real or fictional characters, for technical assistance with model training, for people to generate showcase images for existing models.
- arcticbull 3y ago
  So the choice was not screening for it. Regardless, without moralizing, a choice was made. This is a shocked pikachu situation. [edit] The fact is we've had this kind of content for a long time, and we've developed techniques for identifying and removing it. There's great nudity detecting ML models. I suspect the choice was made in part ideologically, and in part to drive sensationalist coverage, and it looks like it's working.
  - brucethemoose2 3y ago
    They do "screen" it in a way. All the models are categorized and tagged, and I think straight up illegal models are moderated out.
  - dragonwriter 3y ago
    > So the choice was not screening for it No, they screen, remove, and ban people for policy violations. (And that has improved over time, at least, the violations that have slipped through have dropped over time.) What isn't a policy violation is separate things which could be combined together or with other things to make something that would be a policy violations.
PheonixPharts 3y ago
Have you used Civit.ai? While it does cater to audiences interested in "adult" content I don't think any of it's active users would characterize it as "a deepfake marketplace trading in celebrity and private-person identities".
- dragonwriter 3y ago
  > Have you used Civit.ai? The dot in “CivitAI" is between “AI” and “com” if you are referring to the domain name, or just “there isn't one” if you are referring to the name.
enlyth 3y ago
The article is low quality clickbait. Civitai is just a popular place to host stable diffusion models / LORAs / textual inversions, not some kind of fake nudes marketplace. It's the huggingface of stable diffusion.
- dragonwriter 3y ago
  Huggingface is the Huggingface of Stable Diffusion (and a lot of stuff is on both.)

brucethemoose2 3y ago

The models are free without a login. The only way I would characterizing it as a "marketplace," it individuals offering commissions, I guess.

dragonwriter 3y ago
Some are available early exclusively to paid members, and there are onsite model training and generation services, which are paid (in virtual, but can be bought for cash, currency.)
- brucethemoose2 3y ago
  Well huggingface and tons of others offer stable diffusion training services. Google essentially hosts dreambooth with options for a subscription. Thats nothing unique. I dunno about early access.
  - dragonwriter 3y ago
    > Well huggingface and tons of others offer stable diffusion training services. Huggingface also has porn-focussed trained stable-diffusion models. [0] They also have celebrity-trained models. [1] [0] e.g., https://huggingface.co/WolfAether21/NSFW-STABLE-DIFFUSION-LORA/tree/main https://huggingface.co/WolfAether21/NSFW-STABLE-DIFFUSION-LO... [1] e.g., (yes, poor quality from the samples) https://huggingface.co/lora-library/12jenniferl https://huggingface.co/lora-library/12jenniferl

dragonwriter 3y ago

But that wasn't the choice, the choice was to create an open hub for basically everything related to Stable Diffusion, with limits for a broad range of illegal things, but without policies against things that are steps out from that because at even one step out the “well, combined with other things it could be used badly” bans everything. The highlighted bounty feature is technically accurately, but misleadingly, described. Yes, people can and do post requests for models of real celebs there, but they also post requests for fictional character models, for concept models not tied to particular real or fictional characters, for technical assistance with model training, for people to generate showcase images for existing models.

arcticbull 3y ago
So the choice was not screening for it. Regardless, without moralizing, a choice was made. This is a shocked pikachu situation. [edit] The fact is we've had this kind of content for a long time, and we've developed techniques for identifying and removing it. There's great nudity detecting ML models. I suspect the choice was made in part ideologically, and in part to drive sensationalist coverage, and it looks like it's working.
- brucethemoose2 3y ago
  They do "screen" it in a way. All the models are categorized and tagged, and I think straight up illegal models are moderated out.
- dragonwriter 3y ago
  > So the choice was not screening for it No, they screen, remove, and ban people for policy violations. (And that has improved over time, at least, the violations that have slipped through have dropped over time.) What isn't a policy violation is separate things which could be combined together or with other things to make something that would be a policy violations.

PheonixPharts 3y ago

Have you used Civit.ai? While it does cater to audiences interested in "adult" content I don't think any of it's active users would characterize it as "a deepfake marketplace trading in celebrity and private-person identities".

dragonwriter 3y ago
> Have you used Civit.ai? The dot in “CivitAI" is between “AI” and “com” if you are referring to the domain name, or just “there isn't one” if you are referring to the name.

enlyth 3y ago

The article is low quality clickbait. Civitai is just a popular place to host stable diffusion models / LORAs / textual inversions, not some kind of fake nudes marketplace. It's the huggingface of stable diffusion.

dragonwriter 3y ago
Huggingface is the Huggingface of Stable Diffusion (and a lot of stuff is on both.)