32 ms·
Deepfake detector can spot a real or fake video based on blood flow in pixels
- lowbloodsugar 4y agoFor now.
- pestkranker 4y agoI'm sure that one day, most of the things we'll see or hear on the web will be filtered by this kind of software.
- progrus 4y agoNot likely IMO, the arms race will continue. Plus, are you sure you’re eager to sign up for even more censorship-by-opaque-algorithm?
- ben_w 4y agoI'm not eager, but I do think it's inevitable. That said, there are some images I wish I'd never seen. If I could be sure it was only being used for good (by my definition of the word), that would make me eager to install a magical perfect opaque filter algorithm. But it won't be perfect, and it won't only be used for what I consider to be good.
- atonse 4y agoLove the cat and mouse game! So then this will be the next target of better deepfake models, right? We saw that fake pharma tweet that (supposedly, but not really) sent the stock crashing – how long before a fake video of a CEO making an announcement at a fake Davos-like conference stage interview? As a techie, is this going to make things like digital signatures more important? But more realistically though, most of the audience that would do impulsive things won't care to verify.
- notacoward 4y agoHN story a month from now: new deepfake software can evade Intel's detector.
- alteriority 4y agoIf the filter doesn't notice blood flow on a non-deepfaked subject, run.
- Mountain_Skies 4y agoOr we find out that certain population groups have different blood flow patterns, which the system incorrectly identifies as proof of fakery. Or perhaps for some, it's simply not detectible even though they are real live people.
- maxbond 4y agoYeah, neither deepfakes nor deepfake detectors will end epistemology. We'll need to use a multiplicity of tools, with strengths and weaknesses known and unknown, and come to a conclusion based on the preponderance of evidence knowing full well we will sometimes get it wrong.
- AustinDev 4y agoOr we find out some people have dark skin and the blood flow isn't visible to the camera in these situations.
- yieldcrv 4y agoThat's a great observation to make deep fakes more realistic I often think about subtleties that throw us off a little, too bad that disclosing this subtlety reduces the ability to discern
- lattalayta 4y agoSimulating blood flow is a technique currently used in high-end VFX animation for movies. https://www.fxguide.com/fxfeatured/maleficent/ https://www.fxguide.com/fxfeatured/maleficent/
- phonebucket 4y agoPet peeve of mine: articles using stats like 96% accuracy. If the test set had 4% deep fakes, and 96% legitimate videos, a model which always predicts legitimate video would score 96% accuracy, even if it were useless. Stats like precision, recall, F1 scores etc. are important.
- mabbo 4y agoIt's the reality of popular terminology. We only have one word in English that gets commonly used and means "is correct this much of the time". Nuance is lost, but it ensures more people understand the general gist of the article. One could now get meta and discuss the "accuracy of language", but I feel that might just make you more upset :)
- heavenlyblue 4y agoI read that 96% here means guessing both sides of the witha weighted coefficient on how many of them are in the sample.
- asow92 4y agoenhance blood flow in 3... 2.. 1.
- dahdum 4y agoCan this technology eventually detect their heartbeat, or is it just looking at slower changes over time? If the latter it sounds much simpler to defeat, if the former that would have many repercussions. Live heart rate by video analysis would make things like televised court proceedings, congressional hearings, and news interviews much more invasive. Elevated heart rate is a sign of stress, and it wouldn't be long before people were jumping to conclusions over whether someone was lying or hiding their true feelings/intentions.
- sbirch 4y agoThis has actually been done before, awhile ago: https://people.csail.mit.edu/mrub/vidmag/ https://people.csail.mit.edu/mrub/vidmag/
- dahdum 4y agoVery cool, thank you. I'm honestly surprised this dark magic hasn't been (ab)used yet, unless it has some strong limitations.
- bornfreddy 4y agoThis was quite a big news ~10 years ago... I think there are some patents involved, which makes the use of this technique difficult.
- ehsankia 4y agoNot sure if it's quite the same, but Google Fit has a feature that gets your respiratory rate from the selfie camera. They also have one where you put your finger on the camera flash and it uses that to see your bloodflow. https://www.lifewire.com/measure-respiratory-and-heart-rates-with-google-fit-5176887 https://www.lifewire.com/measure-respiratory-and-heart-rates...
- anigbrowl 4y agoCorrect, although those conclusions will be no more useful than existing ones based on facial expressions or lawyers' theatrics. The legal process can be just as stressful for an innocent defendant as a guilty/liable one, arguably more so.
- johnwheeler 4y agoFor now…
- skunkworker 4y agoWon't this be used in the next deepfake as an adversarial network in order to produce more realistic results? It's an endless cat-and-mouse game.
- mumumu 4y agoThis is probably intended for encoding webcam chat between Intel devices. They can hash the video "frames" to detect interception.
- AustinDev 4y ago>It's an endless cat-and-mouse game Yes, this is the way with anything software based that can earn people money. See: video game hacks, SEO manipulation, etc
- deleted 4y ago[deleted]
- yreg 4y agoBut especially so when machine learning is involved since a model can train off its adversary.
- BoorishBears 4y agoNot really special in the case of ML. Before deepfakes, if you wanted to claim a video was doctored in court, you'd find an expert on video editing and have them testify. But the same knowledge that allowed them to identify a doctored video (like 50hz/60hz hum) could be used in an adversarial manner to create a very convincing video. At most deepfakes democratize that "knowledge" in the form of a model, so it still works both ways.
- JadeNB 4y ago> But the same knowledge that allowed them to identify a doctored video (like 50hz/60hz hum) could be in an adversarial manner to create a very convincing video. I don't think it's automatically true that being good at spotting fakes means that you're good at generating fakes. For example, I suspect that I, like most humans, would be pretty good at spotting humanoid robots at the current level of terminology. However, that does not suggest that I would be particularly good at creating humanoid robots that would evade detection.
- mumumu 4y agoThis is not new. It is news because it's from Intel. I looked into that a year or two ago and there were papers on the this. Anyone who is familiar with Euler Video Magnification and with neural network likely though of that. Does this work in encoded videos? I doubt. Intel probably can add a a feature the video encoder and sell it as an authentication service for webcam communication on Intel Plataform.
- erdewit 4y ago> Does this work in encoded videos? For older encodings such as MPEG2, as used in DVDs, it does work. For newer codecs with higher compression I can't extract a heartbeat signal anymore when using the tool that I've written for that (*). (*) https://github.com/erdewit/heartwave https://github.com/erdewit/heartwave
- squarefoot 4y agoI hardly believe it could work on media uploaded on YT and similar platforms, and assuming it does, it would be easily defeated either by over compressing the videos so that subtle chromatic changes are eliminated or applying smoothing filters before reuploading. Should the technology catch on, it's just a matter of time before the appearance of filters that scramble those subtle differences, masking them for example as a grain filter effect, to make it useless.
- carom 4y agoI've always imagined deep fakes would just encode to 360p to make it believable.
- fnordpiglet 4y agoIt frightens me to learn pixels have blood.
- ravi-delia 4y agoThey didn't until the early 2000s, but it turns out the easiest way to increase the resolution is to feed in less information and just give the pixels souls, so they can use free will to fill in the gaps. In a few years they'll have them in CPUs too, they're just running into thermal issues with the blood and the fact that every ensouled CPU inevitably either kills itself at first opportunity or goes insane. Hopefully it'll get hammered out for 5nm.
- autotune 4y agoI'd insert that one quote from Billy Madison here, but your comment is not even worth the copy+paste effort.
- ravi-delia 4y agohttps://en.wikipedia.org/wiki/Joke https://en.wikipedia.org/wiki/Joke See also: https://en.wikipedia.org/wiki/Fiction https://en.wikipedia.org/wiki/Fiction
- autotune 4y agoBy definition, a joke is supposed to be funny. What you wrote was just complete garbage that I would have sooner believed to have been written by a GPT-3 text generator than a human being.
- ravi-delia 4y agohttps://en.wikipedia.org/wiki/Taste_(sociology)#Bad_taste https://en.wikipedia.org/wiki/Taste_(sociology)#Bad_taste
- jongjong 4y agoI hope that the existence of this tech doesn't end up being used as a cover to justify censoring real videos. At the end of the day, in the current tech environment, the most reliable way to know what is real from what is fake is using your own critical thinking skills. It's just unfortunate that most people have really terrible critical thinking skills.
- klyrs 4y agoWell this headline is equally comforting and terrifying.
- seydor 4y ago...for now
- ispo 4y agoWhat about text?