4 ms·
Question: how far away is this from a "person swapping" GAN video synthesis kind of application?
by macawfish 9y ago
Question: how far away is this from a "person swapping" GAN video synthesis kind of application?
- TaylorAlexander 9y agoI’m not sure if you’ve seen the face swapping that was making the rounds recently, but I was thinking this makes whole body swapping look closer.
- macawfish 9y agoThat's exactly what I had in mind, but I'm no expert. And just wait until they've got basic, fluid object recognition down. I've already seen some impressive, old work on coherent in-painting of images. It seems like all these deep learning discoveries are relatively composable too.
- mattbierner 9y agoIf you thought face swapping was bad, just wait until someone uses this tech to create AR goggles that let the wearer see everyone “naked”, like having Superman X-ray vision
- gumby 9y agoIf the software is at all accurate, using that kind of AR google on me should result in retinal scarring.
- rakenrainbow 9y agoWhy would that be 'bad'? If someone finds joy in seeing all people naked, go for it.
- tziki 9y agoI think that's a really good question. IMO this is an essential part of any pipeline aiming to do that, but there's a bunch of hurdles with neural networks that's haven't been crossed yet. The first one that comes to mind is that I'm not aware of any work which would try to teach neural networks to imagine what someone would look like from different angles (aside from relatively restricted settings like facial frontalization). Second, you talk of videos. That means the person needs to look 'consistent' from frame to frame. This isn't a solved problem either, especially when it comes to GANs. I'm sure there are a few other areas that need to be solved.
- eutectic 9y agoI think 'person swapping' would be best done end-to-end. No need to go through something like this.