9 ms·
People are trying to claim real videos are deepfakes
- d23 4y agoAny attorneys here that can discuss the nuances involved in knowingly lying to the court, which I believe carries penalties for the attorney? And why / whether that would or wouldn’t apply here?
- riskneutral 4y agoI'm not a lawyer, but I'm pretty sure that's not a thing. Lying to the court is a routine part of litigation, and there is no penalty or sanction for it - especially not against the lawyers themselves.
- anonymouskimmer 4y agoIn the US, attorneys are officers of the court. They are forbidden from lying to the court at all times. https://www.law.cornell.edu/wex/officer_of_the_court https://www.law.cornell.edu/wex/officer_of_the_court
- dragonwriter 4y ago> I'm not a lawyer, but I'm pretty sure that's not a thing. Lying to the court is a routine part of litigation, No, its not. > and there is no penalty or sanction for it Yes, there is. > - especially not against the lawyers themselves. There is a penalty especially against the lawyers. Heck, lawyers have been suspended from practice for lying to courts outside of their capacity as lawyers.
- pmarreck 4y agoI don't agree that outright lying is tolerated, but one thing I was very disappointed to learn after independently learning about most of the informal logical fallacies is that lawyers do not avoid them. In fact, they use them to win cases. This is tantamount to, but NOT equivalent to, "lying" in my book. Some of the most famous defenses in history, such as Cochran's "if it doesn't fit, you must acquit" https://www.youtube.com/watch?v=NH-VuP_5cA4 https://www.youtube.com/watch?v=NH-VuP_5cA4 were fundamentally, fallacious appeals in nature. Hugely disappointing to me. Would love for a lawyer to chime in on this. If I could come up with any defense of this practice at all, I'd say that if you took my reasoning to its logical extreme, then the persuasive personality of an attorney themselves could be considered a fallacy, and that would be an unreasonable expectation to satisfy the elimination of. You could also argue that if 2 opposing lawyers are both permitted to make fallacious appeals that wouldn't be called out by judges or jury, then in theory they'd mostly cancel each other out. Maybe.
- anonymouskimmer 4y agoNAL. But that's partly why the opposing counsel exists - to point these fallacies out to the jury. Make the other side look untrustworthy.
- DoesntMatter22 4y agoHow would they know it to be factually incorrect?
- deleted 4y ago[deleted]
- deleted 4y ago[deleted]
- sigmoid10 4y agoLying in court is not a crime. You need to be under oath to be able to commit perjury, e.g. by being a witness who is giving testimony which in turn will be used as evidence. Everyone else can lie as much as they want without fear of repercussions.
- anonymouskimmer 4y agoIn the US, attorneys are officers of the court. They are forbidden from lying to the court at all times. https://www.law.cornell.edu/wex/officer_of_the_court https://www.law.cornell.edu/wex/officer_of_the_court
- sigmoid10 4y agoDid noone here read the article? It says the defendants were the ones who were lying. The attorneys just tried to cast doubt on the evidence, which was at best exacerbated by the defendant's claims.
- anonymouskimmer 4y agoThe discussion evolved beyond the article.
- johndhi 4y agoI'm a lawyer. Lol at the other answers. It definitely carries penalties for the attorney. Each US state has passed 'rules of professional conduct' that govern rules that apply to barred attorneys. Lying to a tribunal, or lying to your client, is illegal and you can be disbarred and fined for it. Haven't read this case closely but it sounds to me like the attorneys said "it's possible these are deep fakes" and not "these are deepfakes." The former seems like a reasonable argument to make, but according to the judge, a flawed one.
- bombcar 4y agoFrom my understanding, (good) lawyers will throw every possible defense at the wall (within reason) because one might stick, and if you don't do it at the beginning, you can't call a whoopsiedoodles and go back and try again. This is why they always begin with a petition that the venue is wrong and the court doesn't have jurisdiction, if they want to argue that.
- johndhi 4y agoThat's generally true: you "waive" certain defenses if you don't state them, at certain points in the litigation process. That said, at the most important moments, typically lawyers will focus on the 3-or-so 'best' (in their view) defenses and focus on those. Then if you lose, you can appeal and say the judge didn't consider your 15th-best defense closely enough :)
- d23 4y agoThank you for the informed response. The other answers were causing me pain.
- jdmichal 4y ago> Haven't read this case closely but it sounds to me like the attorneys said "it's possible these are deep fakes" and not "these are deepfakes." The former seems like a reasonable argument to make, but according to the judge, a flawed one. IANAL, but this sounds appropriate to me? Couldn't all forms evidence be hit with various types of "this might be fake" claims? So I think it's fair that the court assert that you must claim "this is fake", then be willing to battle it out with the opposing side. Otherwise it's not a defense, it's just empty words, isn't it?
- lozenge 4y agoMusk's lawyers didn't specifically claim that the videos actually are deepfakes. They refused to say either way. > Tesla could not admit or deny the authenticity of video and audio recordings purportedly containing statements by Mr. Musk https://arstechnica.com/tech-policy/2023/04/judge-slams-tesla-for-claiming-musk-quotes-captured-on-video-may-be-deepfakes/ https://arstechnica.com/tech-policy/2023/04/judge-slams-tesl...
- banana_feather 4y agoDishonesty toward the tribunal is a violation of the rules of professional responsibility/conduct (model rules 3.3 and 8.4(d), the latter is what they disbarred Clinton for). Federal courts have rule 11, where an attorney can essentially call out the opposing counsel after some cure period and ask the court to impose sanctions on the attorney that's getting out of line. State courts have some equivalent. In practice, most lawyers don't lie to the court because their career is dependent on maintaining a working relationship with the courts in which they appear. Even within the same case, if the presiding judge has good reason to believe you're a liar, every subsequent motion or argument you make is going to be viewed with skepticism.
- xur17 4y agoI thought this part was particularly interesting: > "Their position is that because Mr. Musk is famous and might be more of a target for deep fakes, his public statements are immune," she wrote. "In other words, Mr. Musk, and others in his position, can simply say whatever they like in the public domain, then hide behind the potential for their recorded statements being a deep fake to avoid taking ownership of what they did actually say and do. The Court is unwilling to set such a precedent by condoning Tesla's approach here."
- e_i_pi_2 4y agoThis seems like the main point - it's not that court won't accept a deepfake defense, but you would have to prove that it was faked, just like any other convincing evidence
- moffkalast 4y agoDoesn't this also mean that a deepfake presented as evidence of crime makes you guilty until proven innocent?
- bombcar 4y agoNo, just that you can't hand wave away all video evidence by saying "deepfake". It's no more "guilty until proven innocent" than a signed confession means you're guilty unless you prove it fake; that's the whole point of a trial.0
- unshavedyak 4y agoIt also depends on the court in question. Ie in my recent criminal Jury experience; if i were to pretend deepfakes were used then it wouldn't be on the prosecution to prove that the video is without a doubt real, but rather that a "reasonable person" would believe that the video is real. Which is quite open to interpretation. For a Jury i think it would come down to how convincingly the defense argued that the video is a deepfake. Just saying the words "it's a deepfake" hypothetically wouldn't/shouldn't be enough to convince a "reasonable person" to believe all video evidence is now fake without concrete evidence (if any is even possible) from the prosecution. Disclaimer: I'm quite unfamiliar with the nuance of the legal system. But i keep using the words "reasonable person" because this was hammered into us in the Jury. We were given a small book of legal definitions related to the criminal case and just about every page framed each definition around a "reasonable person". This seemed to be how the state defined any nuance between the English language and strict logic. This would, i imagine, help mitigate a hypothetical defense of "all evidence is faked" or w/e.
- WastingMyTime89 4y agoBy people, they mean Elon Musk and Tesla here. No idea of why NPR is so subservient.
- lordnacho 4y agoAlso mentions the Jan 6 people
- lozenge 4y agoCircumspect?
- rcoder 4y ago...because they're constantly being raked over the coals for being "biased", "liberal", and (now, conveniently thanks to Musk in large part): "state-controlled" perhaps? If news events depict one side of the political spectrum unfavorably, "balanced" reporting plays directly into the agenda of that side. Truthful reporting of the news shouldn't always mean "all sides have valid arguments," and yet that is what our current media climate demands.
- thenayr 4y ago[dead]
- ccvannorman 4y ago"Tesla lawyers argue Musk cannot be held accountable for public statements [about car safety] because anyone could have made a deepfake of Musk, so no public statements can be taken seriously." Court laughs.
- noughtme 4y agoThis doesn’t seem unreasonable. Isn’t this already the case for politicians in the US? (Not related to deepfakes, just any public statement). Wouldn’t any legal matters defer to written contracts and TOS?
- TeMPOraL 4y agoIndeed. Given the current state of affairs, I think if anyone were to be a victim of a deepfake smear campaing, Musk is easily in top 10 of the most likely candidates.
- taylodl 4y agoYes, there are downsides to being a dick and trolling the world and thinking it's funny. Who'da thunk it?
- ceejayoz 4y agoMusk is welcome to say "that's a deep fake, I never said that". He can't say "because I'm the target of deep fakes, you can't use any video evidence against me".
- falcolas 4y agoThen let Musk hire an expert who can act as a witness. Let the prosecution do the same. AKA - how technical concerns like this are already argued in court. Photoshop, videos with doubles, and other such impersonation issues have been a thing for a long time, and the courts have found ways to deal with them.
- nh23423fefe 4y agomaking up numbers isn't persuasive.
- DoesntMatter22 4y agoI'm confused how courts will deal with this in the future. We are just entering the age of deep fake voices, convincing ones at least. And there are bound to be plenty of deep fakes that sound like the real person but aren't. Are we now going to be held liable for deepfakes we didn't make? I'm surprised people aren't using this more for divorces and what not. Create a deepfake of your wife and then say "Here's proof my wife was cheating"
- izzydata 4y agoVideos are easy enough to spot as fakes for now, but I've heard really convincing AI audio fakes. Audio only recordings might not be usable as evidence without additional confirmation of authenticity.
- infinitifall 4y agoWhat would "additional confirmation" look like? Are audio/video recordings I take with my phone going to be useless in a decade because deepfakes are virtually indistinguishable and there is no "additional confirmation"?
- TeMPOraL 4y agoThat is a good question, because there are two trends at play here. On the one hand, you have ever improving ability to create deepfake images, videos or audio recordings. On the other hand, AI-based retouching of photos and videos is now pretty much standard on mobile, some of it done by default and hidden from you in software. It wouldn't surprise me if the same was case with voice too. Point being, it'll take more than just looking at the source image/video/audio for signs of AI manipulation, because soon enough, all recordings will be AI-manipulated before even hitting persistent storage. In other words: everything will be deepfake by default, and the issue will turn into telling which deepfakes were done to lie about substantial aspects of reality pertinent to the case, and which ones were made to enhance some non-relevant qualities (aesthetics, compressibility, etc.).
- Raidion 4y ago
- vhcr 4y agoMaybe we could do a blind test of the courts, sending them real and fake videos, and check which percentage of the videos are they really able to verify.
- sharemywin 4y agoyou would probably use experts to show why or why not you think it's fake or not.
- canadianwriter 4y agoWhen courts still use lie detector tests and first person accounts as evidence (both of which have been proven to be close to useless), this will take a while for an actual solution to come by.
- SoftTalker 4y agoLie detector tests are not admissible in court. They are an investigative tool.
- NoZebra120vClip 4y agoSo-called "lie detectors" are based on pseudoscience. They are just as much "investigative tool" as a kazoo can be used for drilling a hole in concrete.
- RecycledEle 4y agoI have had several of my dash cam videos thrown out because "judges" thought they were faked. Even when I uploaded the video to YouTube within 24 hours of the wreck the "judge" said I had years to fake it.
- diydsp 4y agoWhat other elements did they have in them? e.g. was it your video vs police?
- PrimeMcFly 4y agoCouldn't you appeal and get expert testimony to verify the videos?
- SoftTalker 4y agoDepending on the case, the cost may have exceeded the damages at stake.
- mandmandam 4y agoThe way I've seen this work is that the Judge throws that in with 17 other bullshit arguments. And unless you can take a thorough and comprehensive swipe at all eighteen, which takes about 160 pages of filings, then your odds of even being heard on appeal are small. Something like 90% of appeals that do get heard lose anyway. This all costs a lot of money when lawyers cost $150 - $700 per hour. Expert testimony costs about the same. Appeals end up costing from $10k to $50k. And how demoralized are you, to hear your judge saying things like that against you. US judges have little fear of accountability. The statistics there are abysmal. No large media outlet will comment on such a decision. Few higher courts would ever inflict any punishment on the judge. To get punished as a judge you need to either provably ruin hundreds of lives , like in the kids-for-cash scandal [0], or one very wealthy and connected life. > https://en.wikipedia.org/wiki/Kids_for_cash_scandal https://en.wikipedia.org/wiki/Kids_for_cash_scandal
- sidewndr46 4y ago
- Yizahi 4y agoI knew this was a documentary after all :) https://www.imdb.com/title/tt8201186/ https://www.imdb.com/title/tt8201186/
- Ekaros 4y agoAbout Musk case, couldn't you simply gather enough people who were present and ask if this recording matches their recollection of what he said on that day? Just like most witness testimonies work.
- ridgered4 4y agoAll this technology and recordings just amount to eye witness testimony again. Crazy.
- sebzim4500 4y agoThe recording was from 7 years ago, best case a few people remember roughly what was said. No one will remember the exact wording.
- intrasight 4y agoI tell my lawyer friends who are early in their careers that they should build a practice in this area. It's going to be HUGE. My personal opinion is that in a legal court setting that the burden of proof of an audio or video recording being real should be with the party presenting the evidence. Court standards for provenance need to be met before any recordings can even be shown to a jury.
- pengaru 4y agoIt's the Fake News defense all over again, Musk and Trump would make good cellmates.
- anonymouskimmer 4y ago"I only want to be seen as great, I can't handle criticism or ridicule." There are plenty of billionaires who stay far more out of the limelight than either of these two. You want praise? You have to accept scorn.
- thenayr 4y ago[dead]
- pengaru_ret4rd 4y ago[flagged]
- pmarreck 4y agoCouldn't the original copy of a video be sha256-hashed by, say, the recording equipment firmware itself, and then possibly time/date-proofed somehow (such as on, sigh, a blockchain)? Is there a need for a service like this? (I've been looking for something interesting to build.)
- skybrian 4y agoThe general principle is called “chain of custody” [1] and it seems odd that it wasn’t mentioned in the article. Not a lawyer, but it normally doesn’t seem that rigorous? Someone testifies about how the video was recorded and stored, starting from the camera, to show that it’s unlikely to have been tampered with. So it seems like if it comes from a security camera and you can say how it was recorded then that’s good, but if it’s video found on social media and you don’t know who recorded it then that should count against it. I think before building anything, it might make sense to see what security cameras already do? [1] https://en.m.wikipedia.org/wiki/Chain_of_custody https://en.m.wikipedia.org/wiki/Chain_of_custody
- rcoder 4y agoSony, Nikon, and Canon already offer this for select "pro" cameras, specifically for law enforcement use. Having unforgeable signatures on every image-capture device just in case some output file could be submitted as evidence in a civil case would be a privacy and safety _nightmare_, OTOH.
- mensetmanusman 4y agoThis is fascinating, within a few years or so there will be no way to determine whether a video was deep faked or not with 100% accuracy.
- konschubert 4y agoThis had been true forever for documents and letters and other kinds of evidence. Courts can deal with uncertainty
- mensetmanusman 4y agoSure, but it’s going to be trippy for the jury.
- netsharc 4y agoNothing new in Indonesia, a supposedly pluralistic country where the parliament opens with Muslim prayer anyway. If a sex tape of yours get stolen and published, they'll drag you to court for "making pornography". When this happens to someone famous, their first defense is "It's fake!".
- qingcharles 4y agoEssentially all evidence in court is assumed to be inadmissible (potentially fake) until a "foundation" is laid by the party who wishes to use it as an exhibit at trial. I can't just turn up with a random photo or video and ask the court to accept it. Generally this is done by having the person that created the media swear under oath. In the case of a photograph you would have the photographer on the stand and ask them to state that the photo they are shown is the one they took and that it hasn't been edited since they took it. The (toothless) threat of perjury charges is what is supposed to keep this system working and our trials fair. If you want to know more about it, post below. I have a fair bit of experience in this.
- cowpig 4y agoPlease, go on :) What is the process like in practice, and what are its weaknesses? How do you think this process will have to change to account for the ease of fabricating digital evidence?
- qingcharles 4y agoOK, first thing to remember is that in most trials the lawyers for both parties probably know each other and the judge professionally, and often personally, depending a lot on the size of the courthouse/venue (technical term for the geographical area the court hears cases from). This is important because all three sides, plaintiff, defendant, and court (judge) want to make their life as simple as possible. In practice this means that before trial the judge will ask everyone to sort out the foundation before trial so that things can go quickly and in the case of a jury trial the jury's precious time isn't wasted on technical matters (as generally the jury isn't allowed to have an opinion on whether a piece of evidence is real - that is a matter solely for a judge to rule on). What actually happens though, for the most part, is that none of the lawyers want to waste the time of a photographer to come into court to spend two seconds to say "yes" when asked if these are the photos they took. (Getting any witness into court is a nightmare). So the parties agree to "stipulate" the foundation of exhibits. So if the prosecutor asks to introduce a crime scene photo the defense lawyer will accept a stipulation that the photographer would swear to the images. This might buy the defense lawyer some brownie points as it saves the prosecution a lot of grunt work. The judge will also look on it favorably too, so more points there. What is sad is that a lot of cases can be won on foundational grounds if lawyers stop stipulating to make things easier. There are many ways for foundation to fail and lawyers should require foundation to be proven on all but the most infallible cases. One big issue coming through courts is child pornography. In many jurisdictions CSAM is legal if no real minors are involved in its production. To prove an image contains a real minor you either need the photographer (!) to vouch for it, or someone else that can verify the contents (e.g. the victim). There are many other technical pieces to foundation that I could spend hours on. For instance, recorded security cam footage has no "photographer" so it is validated by swearing all the equipment was working fine. The actual court Rules of Evidence for this process are really tiny, and practically all of the determinations are actually made based not on the wording of the rules but from the millions of pages of opinions of appeal court judges (case law) that has been written on this subject over the last few hundred years.
- roddylindsay 4y agoDeepfake detection will always be imperfect. The only solution the epistemological challenge from deepfakes is to securely authenticate legitimate media. The Coalition for Content Provenance and Authenticity (C2PA -- c2pa.org) is an emerging standard to apply cryptographic signatures to media starting in the camera through the editing phase to distribution and consumption. Unfortunately C2PA does not yet have widespread adoption and we are facing a very challenging few years where we will not reliably be able to distinguish real and fake media.
- FireBeyond 4y agoI believe Nikon and Canon both (Canon certainly) absolutely have had this available for at least a decade or more, with hardware modules for their cameras that were able to cryptographically sign raw images to attest that that signed data was direct from the sensor. Was a huge concern once digital cameras became sophisticated enough to use in law enforcement.
- c7b 4y ago> Suddenly there's no more reality," he said. "And that is really worrisome because I don't know how we reason about the world. That seems a bit hyperbole. Sure, it's a regression compared to the state of five years ago. But in the bigger picture, it's only been a bit over a decade that recording devices have become omnipresent, maybe 50 years since retail-grade hardware has existed at all. It's not like humanity has no experience in dealing with situations where there's no (reliable) video evidence. For the longest time, hearsay was all we had. And it's not like we couldn't 'reason about the world' back then.
- phs 4y agoMy partner and I now half-jokingly refer to all legitimate pictures, footage, etc. as "legacy".
- BulgarianIdiot 4y agoWhere "people" are apparently Elon Musk's lawyers.
- sebzim4500 4y agoI'm confused. Did Tesla's lawyers actually claim that video was a deepfake or not?
- aaron695 4y ago[dead]
- xg15 4y ago> In 2016, Elon Musk went on stage at a tech conference outside Los Angeles and made a bold statement about the self-driving capability of Teslas. Apart from the video, wouldn't there have been lots of witnesses who where at the conference in person and saw him make that statement? Even apart from the "burden of proof" debate, it seems kinda dumb to try and set this precedent in a case where the prosecution could actually provide proof of the video being genuine relatively easily. (Unless you want to assume that Musk was playing 8D chess here and intentionally introducing the "everything is fake unless proven otherwise" defense in one of the rare situations where it could actually be disproven, to make it appear less devastating to the judge than it actually is. If that was the plan, the judge wasn't having it though.)
- leobg 4y agoSilly article. Silly evidence. And, sure, silly defense by Elon’s lawyer. If you watch the video, he talks about not self driving in general, but self driving on highways that have barriers. That part, he says, is where autopilot is already a safer driver than a person. It’s around the 1h19m33s mark of the Recode video that’s linked in the article.