3 ms·

FYI, I actually just published a guide on how you can help ensure that ("deepfake") tools that you make are less likely to end up misused like this: https://www

by avivo 7y ago

FYI, I actually just published a guide on how you can help ensure that ("deepfake") tools that you make are less likely to end up misused like this: https://www.technologyreview.com/s/614912/ethical-deepfake-t https://www.technologyreview.com/s/614912/ethical-deepfake-t ... (Also at /newest; 3rd page now, and the other submission. Ideally those topics at least would be merged?) Summary of mitigations: # Limiting users or use cases - User Vetting: Carefully vet those who can use a tool (Example: Synthesia only working with vetted enterprise clients.) - Usage Constraints: Limit the synthesis possibilities. (Example: Humen is providing only a limited set of movements for generated videos.) # Discouraging malicious use of flexible and public tools - Clear disclosure: Ensuring and requiring that manipulated outputs are clearly labeled (including via metadata). - Consent protection: Requiring the consent of those being impersonated. - Detection friendliness: Supporting those working on detection and not seeking to fool detection systems. - Hidden watermarks: Embedding data through robust watermarks. - Usage logs: Storing information about usage and media outputs. - Use restrictions: Enforcing contracts that prohibit forms of violative or malicious use. Not all apply to every system of course. The article has more detail!

eivarv 7y ago
Good article, but for the sake of argument: Don't you think any technical "solutions" to this issue will also eliminate the possibility to use these tools for ethical goals (let's say the roles were reversed or whatever) – in addition to all the other gray-area, and inevitable arms-race of detection/avoidance?
- avivo 7y ago
  Definitely. I mean I think e.g. you could have incredible art projects and experiences created out e.g. of giant undetectable fake crowds. There are real tradeoffs in terms of what we value or need in a society.
  - Lammy 7y ago
    I think technical limitations like this are the worst possible solution. The genie can't be put back in the bottle with any particular technology, and the lack of widespread access and awareness means the damage from any particular deepfake that _does_ get released can be that much higher. There is zero chance this tech won't be in the hands of every government-sponsored group on the planet, not to mention all the other independent bad guys out there online.

by avivo 7y ago

eivarv 7y ago

Good article, but for the sake of argument: Don't you think any technical "solutions" to this issue will also eliminate the possibility to use these tools for ethical goals (let's say the roles were reversed or whatever) – in addition to all the other gray-area, and inevitable arms-race of detection/avoidance?

avivo 7y ago
Definitely. I mean I think e.g. you could have incredible art projects and experiences created out e.g. of giant undetectable fake crowds. There are real tradeoffs in terms of what we value or need in a society.
- Lammy 7y ago
  I think technical limitations like this are the worst possible solution. The genie can't be put back in the bottle with any particular technology, and the lack of widespread access and awareness means the damage from any particular deepfake that _does_ get released can be that much higher. There is zero chance this tech won't be in the hands of every government-sponsored group on the planet, not to mention all the other independent bad guys out there online.