5 ms·

Online Demo of DeepWarp: Photorealistic Image Resynthesis for Gaze Manipulation

84 points by orless 10y ago

orless 10y ago
We had it a few months ago (see https://news.ycombinator.com/item?id=12164728 https://news.ycombinator.com/item?id=12164728) but now there seem to be a demo available online. Sample result: http://imgur.com/a/nyG4Z http://imgur.com/a/nyG4Z Abstract: http://sites.skoltech.ru/compvision/projects/deepwarp/ http://sites.skoltech.ru/compvision/projects/deepwarp/
- rrherr 10y ago
  "Machine Learning Algorithms that Matter, like Machine Translation, Spam Filter or Cat Generation, will find its way inside a Web Browser." https://twitter.com/hardmaru/status/834607972923748353 https://twitter.com/hardmaru/status/834607972923748353
- Sunset 10y ago
  This will revolutionize the meme industry.
teleclimber 10y ago
While the technology is amazing, I am a bit bothered by all these picture and video modifying algorithms. The issue is that we can't know what's real any more. It used to be if you saw a video or a photo depicting an event you could be pretty sure that what you're looking at actually happened. Now, if you see a video of a prominent politician saying something awful in your twitter timeline (or whatever), they may have actually never said anything remotely close. It could be a completely fictional video that looks perfectly realistic[0], made by some teen in Macedonia.[1] I realize photography and video have always been used to trick people into thinking things that aren't true, but this technology enables nuclear-grade deception. I am wondering: is there a use-case for such an algorithm that is practical and good for the world? PS: I know an eye-rolling algo is quite innocuous but I've had this thought on my mind about these in general and needed to air it out. [0] https://www.youtube.com/watch?v=ohmajJTcpNk https://www.youtube.com/watch?v=ohmajJTcpNk [1] https://www.wired.com/2017/02/veles-macedonia-fake-news/ https://www.wired.com/2017/02/veles-macedonia-fake-news/
- cooper12 10y ago
  > It used to be if you saw a video or a photo depicting an event you could be pretty sure that what you're looking at actually happened. This isn't really true. Image manipulation was long possible in the darkroom,[0] and you only need to look to hollywood to see how extraordinary deception can be done. The only thing that's changed these days is cost and ease of doing such manipulations. [0]: https://en.wikipedia.org/wiki/Censorship_of_images_in_the_Soviet_Union https://en.wikipedia.org/wiki/Censorship_of_images_in_the_So...
  - bendykstra 10y ago
    Also, e.g., the Moon landing conspiracy theories involving Hollywood and director Stanley Kubrick.
- noobiemcfoob 10y ago
  > The issue is that we can't know what's real any more. Ultimately, you have to rely on word of mouth and trust your communities. Same story as ever, technology just sped it up.
- Razengan 10y ago
  Technology will eventually give us another way for verifying fact from fake. Just as photographs did for hearsay, and videos did for photographs, now we'll have to wait for some memory-reading tech. :) (Yes, that too will in turn be offset by memory-altering tech. After that we wait for time-travel tech.)
  - astrodust 10y ago
    Memories are perhaps the most easily manipulated of all those things.
    - Razengan 10y ago
      Maybe, but I wonder, if it's not our interpretation of memories that becomes flawed. Maybe the "raw" record of our experiences is stored on a separate layer. I mean, I can close my eyes and flip through a series of images from my last 12 or so waking hours. They seem more like snapshots than a description of what I saw/where I was. Some people may have actual photographic memory [1]. Who knows, at some point in the future people may able to opt-in for implants that record everything around them, at a greater accuracy than brains, but use the brain for storage. [1] https://en.wikipedia.org/wiki/Eidetic_memory https://en.wikipedia.org/wiki/Eidetic_memory
deleted 10y ago
[deleted]
Mao_Zedang 10y ago
Cant wait for this to be used for political purposes.
avenoir 10y ago
I find that the side-to-side motion is nearly natural. However, the up-down movement seems to introduce clipping between the lower eye lid and the iris in addition to slightly smudged upper lid. Still very cool technology. And here I thought Skolkovo was long dead.

84 points by orless 10y ago

We had it a few months ago (see https://news.ycombinator.com/item?id=12164728 https://news.ycombinator.com/item?id=12164728) but now there seem to be a demo available online. Sample result: http://imgur.com/a/nyG4Z http://imgur.com/a/nyG4Z Abstract: http://sites.skoltech.ru/compvision/projects/deepwarp/ http://sites.skoltech.ru/compvision/projects/deepwarp/

rrherr 10y ago
"Machine Learning Algorithms that Matter, like Machine Translation, Spam Filter or Cat Generation, will find its way inside a Web Browser." https://twitter.com/hardmaru/status/834607972923748353 https://twitter.com/hardmaru/status/834607972923748353
Sunset 10y ago
This will revolutionize the meme industry.

teleclimber 10y ago

While the technology is amazing, I am a bit bothered by all these picture and video modifying algorithms. The issue is that we can't know what's real any more. It used to be if you saw a video or a photo depicting an event you could be pretty sure that what you're looking at actually happened. Now, if you see a video of a prominent politician saying something awful in your twitter timeline (or whatever), they may have actually never said anything remotely close. It could be a completely fictional video that looks perfectly realistic[0], made by some teen in Macedonia.[1] I realize photography and video have always been used to trick people into thinking things that aren't true, but this technology enables nuclear-grade deception. I am wondering: is there a use-case for such an algorithm that is practical and good for the world? PS: I know an eye-rolling algo is quite innocuous but I've had this thought on my mind about these in general and needed to air it out. [0] https://www.youtube.com/watch?v=ohmajJTcpNk https://www.youtube.com/watch?v=ohmajJTcpNk [1] https://www.wired.com/2017/02/veles-macedonia-fake-news/ https://www.wired.com/2017/02/veles-macedonia-fake-news/

cooper12 10y ago
> It used to be if you saw a video or a photo depicting an event you could be pretty sure that what you're looking at actually happened. This isn't really true. Image manipulation was long possible in the darkroom,[0] and you only need to look to hollywood to see how extraordinary deception can be done. The only thing that's changed these days is cost and ease of doing such manipulations. [0]: https://en.wikipedia.org/wiki/Censorship_of_images_in_the_Soviet_Union https://en.wikipedia.org/wiki/Censorship_of_images_in_the_So...
- bendykstra 10y ago
  Also, e.g., the Moon landing conspiracy theories involving Hollywood and director Stanley Kubrick.
noobiemcfoob 10y ago
> The issue is that we can't know what's real any more. Ultimately, you have to rely on word of mouth and trust your communities. Same story as ever, technology just sped it up.
Razengan 10y ago
Technology will eventually give us another way for verifying fact from fake. Just as photographs did for hearsay, and videos did for photographs, now we'll have to wait for some memory-reading tech. :) (Yes, that too will in turn be offset by memory-altering tech. After that we wait for time-travel tech.)
- astrodust 10y ago
  Memories are perhaps the most easily manipulated of all those things.
  - Razengan 10y ago
    Maybe, but I wonder, if it's not our interpretation of memories that becomes flawed. Maybe the "raw" record of our experiences is stored on a separate layer. I mean, I can close my eyes and flip through a series of images from my last 12 or so waking hours. They seem more like snapshots than a description of what I saw/where I was. Some people may have actual photographic memory [1]. Who knows, at some point in the future people may able to opt-in for implants that record everything around them, at a greater accuracy than brains, but use the brain for storage. [1] https://en.wikipedia.org/wiki/Eidetic_memory https://en.wikipedia.org/wiki/Eidetic_memory

deleted 10y ago

[deleted]

Mao_Zedang 10y ago

Cant wait for this to be used for political purposes.

avenoir 10y ago

I find that the side-to-side motion is nearly natural. However, the up-down movement seems to introduce clipping between the lower eye lid and the iris in addition to slightly smudged upper lid. Still very cool technology. And here I thought Skolkovo was long dead.