5 ms·
Hiding secret codes in light protects against fake videos
- ranger_danger 1y agoNope, it just means the faker has more work to do. I don't think there's any possible solution that cannot also be faked in itself.
- xandrius 1y agoOf course it would, the same way encrypting data works. Encrypt some data in the video itself (ideally every frame changing), unique and can be created only by the holder the private key. Anyone can verify it. Flag reused codes. That's it?
- vorgol 1y agoI have hitherto not timestamped or cryptographically signed my light sources, but that's something I'll be looking into.
- wongarsu 1y agoMight be interesting if you are a high-value individual. Maybe in the future we will see a secret service member shining a light on the POTUS at all times to ensure that no fake video of the President can be circulated. Maybe with a scheme where they publish the keys used after each day, to build trust and make sure anyone can verify the authenticity of any video containing the President Or anyone else who cares enough about deepfakes and can afford the effort
- kevinventullo 1y agoI’m not sure I understand. Could someone not take an existing legitimate video, light and all, then manipulate it to e.g. have the president saying something else?
- wongarsu 1y agoIf you don't manipulate the visual part, lip movements wouldn't match up to what's said. If you do manipulate it that now has to respect the super special light. I don't think it'd be impossible, but it'd be far harder than a regular deepfake. And even if you succeed (or someone writes good software that can do it) the white house can still point to the original video to show that the two were presumably taken at the same time, so one of them must be fake. It'd agree that it's a lot of effort for very marginal gain
- ARob109 1y agoWonder if you could measure your breathing rate and heartbeat and cryptographically sign the time series data as ground truth. Then post process the video with Eulerian Video Magnification to recover the values and compare. edit forgot the link: https://people.csail.mit.edu/mrub/vidmag/ https://people.csail.mit.edu/mrub/vidmag/
- do_not_redeem 1y agoThe codes from the OP are just flashes of light in the environment. The attacker could read the codes and overlay them onto another video, without needing to decrypt them. That's just a standard replay attack. If you flag a reused code in 2 different videos, how do you tell which video is real?
- zhivota 1y agoThe light source could be connected to a clock and the flashes represent the encryption of the time using a private key, verifiable using a public key. It's a lot of complexity, so probably only worthwhile for high value targets like government press conference rooms, etc.
- do_not_redeem 1y agoThat still doesn't help, because the flashes are independent of the content of the video. To illustrate: echo "This comment was posted at 18:21 UTC" | sha256sum 4f51109e71ec4df85a52affec59a9104837664be3008d1bd70cb8b4fbe163862 - You could easily copy those flashes of light into your next comment if you wanted, without reversing the hash.
- hamburglar 1y agoFrom the paper: “ rather than encoding a specific message, this watermark encodes an image of the unmanipulated scene as it would appear lit only by the coded illumination” They are including scene data, presumably cryptographically signed, in the watermark, which allows for a consistency check that is not easily faked.
- do_not_redeem 1y agoThat's just saying that the coded image will only be apparent in the areas of the image lit by the light. Which is obvious, that's how a flashlight works too. They're not signing the actual pixels or anything. They've increased the difficulty to that of 3D-mapping the scene and transferring the lighting: not trivial, but still two long-studied problem spaces.
- ranger_danger 1y agoI don't think encryption is comparable to a simple duplication of data.
- edm0nd 1y agokinda like captchas. they really do nothing to prevent someone from continuing to scrape data or do something malicious. it only slows them down or makes them spend $2.99 per 1000 successfully solved captchas or less.
- do_not_redeem 1y agoI thought we were finally getting away from that "subtly flickering fluorescent lights" vibe in public spaces that gives 30% of the population headaches. But I guess we're bringing it back. Another victory for AI!
- 3036e4 1y agoHave a vague memory of some old HN discussion about how known fluctuations in light because of slightly varying electricity frequency have been used already to detect fake video and that databases exist with information about frequencies by location and time for this purpose?
- _neil 1y agoMight have been audio? https://phys.org/news/2018-02-power-grid-fluctuations-hidden-audio.amp https://phys.org/news/2018-02-power-grid-fluctuations-hidden...
- tantalor 1y agohttps://pmc.ncbi.nlm.nih.gov/articles/PMC9304164/ https://pmc.ncbi.nlm.nih.gov/articles/PMC9304164/ > Electric network frequency is a signal unique over time and thus can be used in time estimation for videos.
- mpascale00 1y agoWithout having read into this deeper, it sounds like someone could take an original video which has this code embedded as small fluctuations in luminance over time and edit it or produce a new video, simply applying the same luminance changes to the edited areas/generated video, no? It seems for a system like this every pixel would need to be digitally signed by the producer for it to be non-repudiable.
- crazygringo 1y agoExactly, that is my question too. If you can detect the lighting variations to read and verify the code, then you can also extract them, remove them, reapply to the edited version or the AI version... varying the level of global illumination in a video is like the easiest thing to manipulate. Although there's a whole other problem with this, which is that it's not going to survive consumer compression codecs. Because the changes are too small to be easily perceptible, codecs will simply strip them out. The whole point of video compression is to remove perceptually insignificant differences.
- janaagaard 1y agoAs I understand it, the brilliant idea is that the small variantions in brightness of the pixels look just like standard noise. Distinguishing the actual noise from the algorithm is not possible, but it is still possible to verify that the 'noise' has the correct pattern.
- ewidar 1y agoWhile it does not seem enough to guarantee authenticity, this scheme does seem like it would prevent creating a video from scratch pretending to be taken at a protected location without having express knowledge of the key or the flickering at that moment in time. Definitely interesting for critical event and locations, but quite niche.
- SoftTalker 1y agoMy question would be, who does have "express knowledge of the key or the flickering at that moment in time" and are they trustworthy?
- ewidar 1y agoThat would be whoever owns the private key, no? It's similar to any other private/public key scheme: it just serves to prove the signature was generated by the owner (here whoever owns the location at which the video is taken). But I guess you could imagine multiple flickering patterns per location, with each pattern being owned by a different entity (an NGO + a governement + a private company for example), in essence doing a multi-sig of the video.
- deleted 1y ago[deleted]
- neilv 1y ago> “Each watermark carries a low-fidelity time-stamped version of the unmanipulated video under slightly different lighting. We call these code videos,” If this is the only info that's encoded, then that might not be an entirely bad idea. (Usually, the stego-ing of info can help identify, say, a dissident who made a video that was critical of a regime. There are already other ways, but defeating them is whack-a-mole, if universities are going to keep inventing more.) > Each watermarked light source has a secret code that can be used to check for the corresponding watermark in the video and reveal any malicious editing. If I have the dissident video, and a really big computer, can I identify the particular watermarked light sources that were present (and from there, know the location or owner)?
- TeeMassive 1y agoThis is apparently how they located Ben Laden in Pakistan, usisng drones and watermarked sounds.
- ada1981 1y ago[flagged]
- stirfish 1y agoThe spire tore a hole through the side of the building and it was left burning for hours. https://www.youtube.com/watch?v=KMvCWFCoVN4 https://www.youtube.com/watch?v=KMvCWFCoVN4
- ada1981 1y agoGreat video.
- LorenPechtel 1y ago1) Did you not see the big gash in the side from being hit by one of the main towers? You'll have to do some looking to find the images because of course the gash was facing the main towers and thus was mostly obscured by the smoke. Very lousy view, few cameras were pointed that way. 2) They did not fight the WTC 7 fire because the collapse of the main towers took out the water main. Note that it's not that skyscrapers can't be brought down by fire, but that in most cases the fire prevention buys the fire crews enough time to fight the fire.
- yodon 1y agoIt's rare that I think an academic paper from a good school that is trending on HN is actively stupid, but this is that paper. If you're even considering going to go to all the trouble of setting up these weird lights and specialized algorithms for some event you're hosting, just shoot your own video of the event and post it. Done. "Viewers" aren't forensic experts. They aren't going to engage with this algorithm or do some complex exercise to verify the private key of the algorithm prior to running some app on the video, they are just going to watch it. Opponents aren't going to have difficulty relighting. Relighting is a thing Hollywood does routinely, and it's only getting easier. Posting your own key and own video does nothing to prove the veracity of your own video. You could still have shot anything you want, with whatever edits you want, and applied the lighting in software after the fact. I'm sure it was fun to play with the lights in the lab, but this isn't solving a problem of significance well.
- GauntletWizard 1y agoYes, I think that the state of modern video generation has made an uncomfortable truth more clear - All Evidence is hearsay, only as trustworthy as the people you're getting it from. For a brief shining moment video evidence was easy to produce but hard to forge, but that's not been the case for most of history. That's why the law has so much detail about evaluating the trustworthiness of witnesses.
- skhameneh 1y agoThis can be used for automated detection and flagging. I’m under the impression this isn’t for end users, it’s for enforcement within context of intellectual property. I’m curious to see what the value proposition is as it’s unclear who would be buying this and why. I suppose platforms might want it to prove they can help or offer services to enforce brand integrity, maybe?
- davidee 1y agoI think you might have misunderstood some core use cases. One significant problem currently is long form discussions which are taken wildly out of context for the sake of propaganda, cancelling or otherwise damaging the reputation of those involved. The point isn't that a given video isn't edited originally, but that the original source video can be compared to another (whether the original was edited or not is neither here nor there). I'm not saying this solution is the answer, but attempts to be able to prove videos were unedited from their original release is a pretty reasonable goal. I also don't follow where the idea that viewers need to be forensic experts arises from? My understanding is that a video can be verified as authentic, at least in the sense of the way the original author intended. I didn't read that users would be responsible for this, but rather that it can be done when required. This is particularly useful in cases like the one I highlighted above; where a video may be re-cut to make an argument the person (or people) in question never made (and which might be used to smear said persons–a common occurrence in the world of long form podcasting as an example).
- armchairhacker 1y agoA more accessible thing that protects against fake videos, at least in the short term, is multiple cameras and a complicated background. Maybe eventually we get a model that can take a video and "rotate" it, or generate a 3D scene that can be recorded at multiple angles. But maybe eventually we may get a model that can generate anything. For now, 4o can't maintain obvious consistency with so many details, and I imagine it's orders of magnitude harder to replicate spatial/lighting differences accurately enough to pass expert inspection. If you want solid evidence that a video is real, ask for another angle. Meanwhile, anything that needs to be covered with a camera (security or witness) should have at least two.
- snickerbockers 1y agoEven if everything they say is true, that wouldn't prove a video is fake, at best it proves a video is real. If people will accept "our high-profile defendant in the segregated housing unit of a maximum security prison hung himself with a makeshift noose fashioned from blankets off a bedpost that isn't even as tall as he is while the guards were playing 3d space cadet pinball and the camera was broken and his cellmate was in solitairy", surely they will accept "our maintenance guy used regular lightbulbs from home depot instead of the super secure digital signature bulbs". Or maybe "we installed the right bulbs but then we set the cameras to record in 240p MPEG with 1/5 keyframe per second because nobody in the office understands how digital video works". Anyways I'm of the opinion that the ultimate end-state of deep fakes will be some sort of hybrid system where the AI creates 3d models and animates a scene for a traditional raytracing engine. It lets the AI do what its best at (faces, voices, movement) and eliminates most of the random inconsistencies. If that happens then faking these light patterns won't be difficult at all.
- KumaBear 1y agoI will argue one point. People think guards sleeping all shift is part of the conspiracy. This is the reality of the majority of jails and even law enforcement. I’d be more surprised if they were awake not scamming. It’s very common. (Experience in the profession)
- snickerbockers 1y agoI agree, but the thing about the Epstein scandal is that just about any individual aspect of it could plausibly be a coincidence when examined in isolation. It's only when you look at the entire scandal at once that it becomes obvious something is seriously wrong due to the enormous piles of "coincidences" this man leaves in his wake everywhere he goes.
- V__ 1y agoI applaud the idea to mark videos as real, but somehow I don't think it matters. People disagree on facts and reality and ignore contradictions or proof to the contrary. If fact-cheking is already used as a slur or dog whistle in some circles, then what can a reality-watermark accomplish?
- cluckindan 1y agoIf it’s not directly human-verifiable, people have to rely on 3rd party tools or official/media statements to verify content legitimacy. Such reliance requires trust in authorities and media, which have both been subject to systematic erosion as of late. I don’t see the point of this technology. It might be useful for entities like Meta and Google, which could use it to warn of fake content. However, in practice that amounts to giving those entities more power over our perceptions and the realities we build upon them.
- ztown 1y agoI'm finding that AI seems incapable of generating aperiodic monotile designs. I suspect this is because the shape is nowhere in any training data, and it doesn't pattern--so without patterns to train on, it produces obvious errors. It invents geometry that stands out like a sore thumb. I think it has potential to serve as protection against deepfakes. I made an online store around all this, but I haven't really advertised it because I'd like a little more confirmation before I run with it. Would love some feedback on the idea
- LorenPechtel 1y agoIt could be counterdesigned, but I agree, that would be a nightmare for any AI engine not specifically set up to do it. I'm reminded of a novel that I utterly can not recall in general, but I'm thinking of a scene where someone realizes they're in a simulation because the sidewalk cracks are wrong. They knew the real scene there happened to be a shape (of what I can't recall) in the cracks, the simulation was showing random cracks. I don't think it even requires a monotile. Just use an event-specific non-repeating pattern on a backdrop.
- dragonwriter 1y agoSo, if the technical end of this really works, whoever controls the venue and its records can control what videos (real or fake) are considered “real”, in the rare circumstances where the kind of forensics needed to verify it would be employed. Unfortunately, in most of the cases where that would be useful, that's also a party pretty high on the list of “who are we concerned about manipulating video”, so...
- thewanderer1983 1y agoReminds me of the 'mains hum' technique that was used to identify videos. Can also be done with light. https://www.youtube.com/watch?v=e0elNU0iOMY https://www.youtube.com/watch?v=e0elNU0iOMY https://en.wikipedia.org/wiki/Electrical_network_frequency_analysis https://en.wikipedia.org/wiki/Electrical_network_frequency_a...
- lazyeye 1y agoThe entire mainstream media will have no business model if they are not able to edit live video to support their preferred narrative.
- __MatrixMan__ 1y agoI'm not sure that raising the bar for how expensive it is to fake a video is the right step to take. That'll just preserve, for a little while longer, the false sense of security that comes from seeing a video and assuming it's real. Meanwhile, the well funded bad actors will remain uninhibited (and aren't they the scariest ones?) It looks like fun research, but I think we'd get a lot better bang for our buck persuring ways to attach annotations to a video like: > I was there and I saw this happen ...such that you can find transitive trust paths from yourself to a verifier who annotated the video. That'll require a bit of trust hygiene that the common folk aren't prepared for, but I dont think there's any getting around preparing them for it.
- dsign 1y agoThe problem of authenticating footage has a disappointing but sufficient solution: 1.- Use filming devices that sign the footage with a key, and the device has some anti-tamper protections to prevent somebody from stealing the key. 2.- The thing above is useless for most consumers of the footage, which would only see it after three to four transcodings change the bytes beyond recognition. But in a few years everybody will assume most footage in the Internet is fake, and in those cases when people (say, law enforcement) want to know for sure if something really happened, they’ll have to go through the trouble of procuring and watching the original, authenticated file. The alternatives to 1 and 2 are: a) To engage in an arms race, like the one which is happening with captchas right now. b) To roll back this type of AI. b is not going to happen, even with a societal collapse and sweeping laws against GenAI, because the way GenAI works is widely known. Unless we want to roll back technology itself and stop producing the hardware, and culture so that people don’t know how to do any of this.
- thatoneguy 1y agoFilm worked for a long time (and still works) despite the availabilty of film printers.
- a2128 1y agoThe whole "digital cameras with unhackable authenticity signatures" idea can kind of be broken by just pointing a camera at a screen. It sounds a bit ridiculous but screen density and dynamic range is quite high these days, with the right setup you could play a deepfake video and get it to look real AND have a signature saying it's totally authentic
- ScoutRap 1y agoThis seems similar idea to audio water marking. https://en.wikipedia.org/wiki/Cinavia https://en.wikipedia.org/wiki/Cinavia This stopped me from playing any movie that had this implemented via PS3 Media Server on my PS3. Most movies that are done by Sony Pictures will have this implemented. I ended up using my Xbox 360 instead because Microsoft would not pay to license the tech IIRC.