3 ms·

Lets hope the primary uses are entertainment and maybe communication. It will soon be possible to create a realistic video of anyone doing anything.

deleted 3y ago
[deleted]
numbsafari 3y ago
Which is why we need laws that make doing so without very explicit consent for every generated work a felony offense with social and penal consequences equivalent to rape.
- sorenjan 3y ago
  That won't help against nation states spreading propaganda or manufacturing false evidence. If you thought Russian Twitter trolls were bad in 2016, wait until you see the TikTok trolls of tomorrow. This won't be regulated away, it will happen and everyone should be educated and prepared. That's just an unrealistic dream though, enough people will get fooled (I will probably be among them at least some of the time) that it will have consequences. Deepfakes have been used for scams for years already: https://www.youtube.com/watch?v=vqr0oER03SE https://www.youtube.com/watch?v=vqr0oER03SE
  - numbsafari 3y ago
    Murder isn't regulated away, either. Yet it is still against the law, and society invests in its prevention, and empowering the victims of violence with a civil means to seek retribution and protection. The situation is very similar to CP, and should be treated in a similar fashion.
- positus 3y ago
  An abundance of laws is little help against the evil intentions of the human heart.
  - numbsafari 3y ago
    It would give victims a path to defend themselves. Today, they have nothing.
    - semiquaver 3y ago
      Deepfake videos aren’t covered by existing libel law?
      - numbsafari 3y ago
        To the best of my knowledge, in the US, there is no explicit law and libel/defamation laws have not been adequately tested and it is understood that they have very serious limitations, especially for those who previously engaged in sex work. > But no federal law criminalizes the creation or sharing of non-consensual deepfake porn in the United States. A lawsuit is also unlikely to stand up in civil court. https://www.wbur.org/endlessthread/2023/06/23/deepfake-pornography-law https://www.wbur.org/endlessthread/2023/06/23/deepfake-porno... > ... if someone makes a deepfake or otherwise posts a nonconsensual video of someone who does sex work, the defense could argue that because the woman’s reputation already involves sexual activity, her reputation is not being defamed by another video of sexual activity. Such an argument — and thus pursuit under defamation as a whole — would be missing the actual point, which is the violation of consent. https://www.cyber.forum.yale.edu/blog/2021/7/20/deepfake-pornography-beyond-defamation-law https://www.cyber.forum.yale.edu/blog/2021/7/20/deepfake-por...
Aardwolf 3y ago
Would it be too optimistic to say that if we can create realistic videos of anyone doing anything, the general public will not believe in videos as evidence anymore anyway? And so it wouldn't matter soon, except it would matter for a different thing, namely we'll lose the ability to use legit videos as evidence of anything. On the other hand, it has been possible for an extremely long time (millenia) already to create text of anyone doing anything, and in general it seems we can still trust text mostly (and can distinguish somewhat well between false and reputable textual sources), so maybe it's all reputation based, also for video in the future.
Podgajski 3y ago
I could also see government agencies using this to frame people for crimes they do not commit.
- danielbln 3y ago
  Thanks to insightface anyone can already deep fake any video with a single input image in a few seconds.

deleted 3y ago

[deleted]

numbsafari 3y ago

Which is why we need laws that make doing so without very explicit consent for every generated work a felony offense with social and penal consequences equivalent to rape.

sorenjan 3y ago
That won't help against nation states spreading propaganda or manufacturing false evidence. If you thought Russian Twitter trolls were bad in 2016, wait until you see the TikTok trolls of tomorrow. This won't be regulated away, it will happen and everyone should be educated and prepared. That's just an unrealistic dream though, enough people will get fooled (I will probably be among them at least some of the time) that it will have consequences. Deepfakes have been used for scams for years already: https://www.youtube.com/watch?v=vqr0oER03SE https://www.youtube.com/watch?v=vqr0oER03SE
- numbsafari 3y ago
  Murder isn't regulated away, either. Yet it is still against the law, and society invests in its prevention, and empowering the victims of violence with a civil means to seek retribution and protection. The situation is very similar to CP, and should be treated in a similar fashion.
positus 3y ago
An abundance of laws is little help against the evil intentions of the human heart.
- numbsafari 3y ago
  It would give victims a path to defend themselves. Today, they have nothing.
  - semiquaver 3y ago
    Deepfake videos aren’t covered by existing libel law?
    - numbsafari 3y ago
      To the best of my knowledge, in the US, there is no explicit law and libel/defamation laws have not been adequately tested and it is understood that they have very serious limitations, especially for those who previously engaged in sex work. > But no federal law criminalizes the creation or sharing of non-consensual deepfake porn in the United States. A lawsuit is also unlikely to stand up in civil court. https://www.wbur.org/endlessthread/2023/06/23/deepfake-pornography-law https://www.wbur.org/endlessthread/2023/06/23/deepfake-porno... > ... if someone makes a deepfake or otherwise posts a nonconsensual video of someone who does sex work, the defense could argue that because the woman’s reputation already involves sexual activity, her reputation is not being defamed by another video of sexual activity. Such an argument — and thus pursuit under defamation as a whole — would be missing the actual point, which is the violation of consent. https://www.cyber.forum.yale.edu/blog/2021/7/20/deepfake-pornography-beyond-defamation-law https://www.cyber.forum.yale.edu/blog/2021/7/20/deepfake-por...

Aardwolf 3y ago

Would it be too optimistic to say that if we can create realistic videos of anyone doing anything, the general public will not believe in videos as evidence anymore anyway? And so it wouldn't matter soon, except it would matter for a different thing, namely we'll lose the ability to use legit videos as evidence of anything. On the other hand, it has been possible for an extremely long time (millenia) already to create text of anyone doing anything, and in general it seems we can still trust text mostly (and can distinguish somewhat well between false and reputable textual sources), so maybe it's all reputation based, also for video in the future.

Podgajski 3y ago

I could also see government agencies using this to frame people for crimes they do not commit.

danielbln 3y ago
Thanks to insightface anyone can already deep fake any video with a single input image in a few seconds.