8 ms·
“ “Scary though if it isn’t a deepfake,” Shamook added. “This could be the start of people being able to discredit real evidence by simply saying ‘deepfake.'” “
by mensetmanusman 6y ago
“ “Scary though if it isn’t a deepfake,” Shamook added. “This could be the start of people being able to discredit real evidence by simply saying ‘deepfake.'” “
This.
I have been in a jury, and I wouldn’t be surprised if image based evidence won’t always be discounted by defense attorneys. It probably is already starting for the high paid ones (e.g. the notion itself will protect the rich.)
It brings up an interesting future where you can’t trust any witness testimony (because people do misremember) or any video, image, or audio evidence due to this technology.
The only societal workaround will be to implant cryptographic keys inside of bodies and monitor all interactions on some blockchain /s?
- jmcqk6 6y agoI don't think this is new at all. The specifics might be new, but the problem is quite old, and has been with us for thousands of years. I think the danger is in trying to come up with an abstract, general solution for it. I don't think one exists. I think the only thing we can do is deal with things on a case by case basis in these situations.
- pvarangot 6y agoI thought that juries are instructed to decided when it's "beyond any reasonable doubt"? So if the defense wants to discredit video evidence they have to make a case that that's a reasonable doubt, probably have experts review the video and provide at least a sketch up of the motive behind spending resources on forging evidence like that. Also I understand that in most cases that go to trial there's more than just video evidence.
- Ma8ee 6y agoIt would surprise me if there aren’t cases where the only evidence is security camera footage.
- paxys 6y agoIMO it's a step in the right direction. Photos and videos should at minimum be signed/cryptographically verifiable if they are used as key testimony in court. We have had the tools to easily and convincingly fake photos for decades now. I can bet there are people behind bars today because someone got creative with photoshop.
- ben0x539 6y agoHm, I'm out of the loop here, who would sign the photos? The camera app?
- AnthonyMouse 6y ago> Photos and videos should at minimum be signed/cryptographically verifiable if they are used as key testimony in court. This kind of "verification" doesn't work. You're trying to have the device authenticate the image. That implies a root of trust that goes through the device manufacturer, which state actors will immediately compromise, making the signatures untrustworthy regardless. Then people will find vulnerabilities in the devices themselves, or convincing ways to have the device take a picture of a doctored photograph instead of a picture of the world, extending the ability to forge signatures to the general public. The resources needed to forge a signature aren't going to be much different than the resources needed to create a deepfake to begin with. The creator gets to choose which device to use and can choose based on which device they find a vulnerability in. So it's more likely to be a liability than a benefit because it lends false credence to the authenticity of fakes. For it to work you would need all devices to be secure against all attackers. It's not realistic.
- chrisco255 6y ago> The resources needed to forge a signature aren't going to be much different than the resources needed to create a deepfake to begin with. How? If you have a public/private key pair and then do some kind of multisig process wherein the manufacturer can sign the photo, the OS can sign the photo, and then a user supplied signature could also sign the photo. You're not going to be able to fake 3 cryptographic signatures without 3 private keys. It would be extremely difficult to fake all of that. It would take a concerted, concentrated effort and would be extremely rare in practice. It would certainly improve the situation.
- AnthonyMouse 6y agoOnce you compromise the device it doesn't matter how many keys there are because they all have to be on the device.
- throwaway17_17 6y agoThe other aspect of discounting image evidence in this way would be to produce multiple conflicting versions and then argue a jury can never be sure which is real (where deepfake quality is comparable to the law enforcement original). This would have a hurdle for admission in a criminal case, but I would be able to very easily argue an acquittal if it was presented to the jury.
- interestica 6y agoI think you just created a new field/job.
- woah 6y agoIt's always so odd when people assume that there were no functioning legal systems during the tens of thousands of years of human history before photography was invented
- xmprt 6y agoPeople lived before the Internet existed but it would be a huge setback if we lost it. Similarly, advancements in technology have allowed for our justice systems to be a lot better and it would be a real shame if we lost that because of deepfakes. I'm not saying it will go that far, but it's totally normal to be wary of it.
- buran77 6y agoThe question is how effective that justice system was, not whether it existed or not. It's the same with medicine, it existed for quite some time but the effectiveness increased drastically and you wouldn't want to roll back all that progress. The reality is that for most of those tens of thousands of years justice systems were mostly a sham where the focal point wasn't actually determining innocence but rather the appearance of justice and pleasing (some) people.
- tshaddox 6y agoOr now, for the vast majority of cases where direct photographic evidence would be useful but does not exist.
- nickysielicki 6y agoThe phrasing of this rubs me the wrong way -- I get the feeling that you're more afraid of guilty people being presumed innocent than you are of innocent people being framed by deepfakes. Our justice system worked for a very long time in an environment where cell phones didn't exist, where cities weren't covered end-to-end in CCTV cameras, and our courts were able to do a decent job of protecting the innocent and putting away the bad guys. Distrust of video evidence only makes us revert back 30 years to when we weren't so monitored. It's something that we can survive. On the other hand, if we don't see an outright rejection of deepfakes in our courts, we're going to see it used as a political weapon. We can survive the former, but not the latter. Unfortunately, I don't see it working out that way. Once courts and police get their hands on a new technology and it becomes sufficiently ingrained, it doesn't matter how little sense it makes. Drug dogs are bullshit, but they're still everywhere. [1] DNA evidence can be synthesized and planted, but it's the gold standard in terms of courtroom evidence. [2] Given all of this, I don't have a lot of faith in our justice system getting deepfakes right, and that worries me a lot more than guilty people being presumed innocent. [1]: https://www.washingtonpost.com/opinions/2019/02/05/supreme-courts-alternative-facts-about-drug-sniffing-dogs/ https://www.washingtonpost.com/opinions/2019/02/05/supreme-c... [2]: Good reason to avoid giving your DNA to 23andMe or to the state. Unfortunately, both my parents did 23andMe, so I'm screwed regardless. https://www.nytimes.com/2009/08/18/science/18dna.html https://www.nytimes.com/2009/08/18/science/18dna.html
- rossdavidh 6y agoI don't think the history regarding how courts (and juries) handled eyewitness testimony, is all that different from how they handle DNA evidence. It's regarded as far more reliable than it is.
- Klinky 6y agoThe track record of the justice system has been extremely mixed for many, and downright awful for minorities. DNA testing has been absolutely crucial in the last 30 - 40 years for undoing some of the damage the justice system caused before DNA testing was adequately available. There is no comfort found in regressing backwards to where forensic science becomes easily dismissible, and we're reliant on who can buy the most prestigious expert witness to testify for them.
- throwaway0a5e 6y ago>It brings up an interesting future where you can’t trust any witness testimony (because people do misremember) or any video, image, or audio evidence due to this technology. That future sounds a lot like the past where we couldn't trust testimony and audiovisual evidence was practically nonexistent.
- grobbles 6y agoThere is a recent British Netflix series called "The Capture" that is pertinent to this discussion. A little absurd at times, but for anyone who wants some mental floss around this topic it's a very interesting show.
- fxtentacle 6y agoThere already are services who claim to be able to verify the authenticity of images. And so far, I managed to fool all of them with good CGI videos injected through MIPI into an Android system. I remember that TruePic was especially awful, because their app fell for me just taking a photo of a printed out image. Plus their website overflows with Blockchain and Crypto buzzwords
- Yajirobe 6y ago> There already are services who claim to be able to verify the authenticity of images. And so far, I managed to fool all of them with good CGI videos injected through MIPI into an Android system. Not to mention adversarial attacks will probably always exist, so there will always be a way to fool these systems.
- drdeadringer 6y agoI remember an episode of the Olde Time Radio show "The Shadow" where Lamont and Margo attend a trial as audience members. This is in the 1930s // 1940s for context. The prosecution projected a film with audio [cutting edge technology at the time] demonstrating the crimes in question [bribery and related charges]. Lamont ['The Shadow'] was able to hear the audio and read lips at the same time and figure out that what was heard was not was what said. "Believe half of what you see, and nothing you hear" was his takeaway. As the story goes, that's what happened. The film shown at court was dubbed for audio by a hired guy who did great vocal impersonations. The accused was innocent. Short story long: deep fakes aren't a new idea. 100 years and counting. Same trick, different tools.