4 ms·
I've been wondering what is going to happen when bots start using these images as profile pictures? Previously it wasn't trivial to do a GAN image generator, n
by AndrewKemendo 8y ago
I've been wondering what is going to happen when bots start using these images as profile pictures?
Previously it wasn't trivial to do a GAN image generator, now as this site shows it's, if not trivial, also not particularly hard.
- hopler 8y agoWhat's the practical difference between a synthetic fake profile photo and a stolen filtered real one?
- AndrewKemendo 8y agoSpeed of content generation. You can create thousands of synth ones a second.
- gambler 8y agoSince it uses a deep neural network, I don't think it's "thousands a second". Also, you can download an image and crop a face out of it in several seconds. You could even automate the process. The biggest problem is transferring faces to existing photos. It was hard to do manually. Now it's much easier. Also, people are generally trained to ignore various artifacts by CGI-ridden movies and compression algorithms. So much of our notion of how the world looks comes from digital imagery, it's kind of scary. I think we need to change the threshold of quality for an image/video to constitute "proof" of any kind. You can hide most of the weird artifacts by scaling things down or passing them through heavy compression.
- gwern 8y ago> Since it uses a deep neural network, I don't think it's "thousands a second". The generator is like 150MB. The forward pass is <0.1s. Hypothetically you should be able to generate on a decent GPU like a 1080ti with 11GB VRAM at full utilization <730 images per second. Use a few GPUs and you're at thousands per second.
- gambler 8y agoWhere is this data from? I see 300MB model on their Google Drive. And if I understand correctly, you also need source and destination images to transfer styles from and to, so it's not like the model generates photos out of thin air.
- gwern 8y agoThe 300MB model covers both the G and D. You only need G to generate. The style transfer is just noise. And I time my own 512px anime StyleGANs at ~21 images per second per model; half that throughput to account for the increased model size and depth of a 1024px. No matter how you tweak the numbers - halve it again if you wish! - it's clear that thousands per second is entirely attainable with a few GPUs at low cost. (For comparison, 8 V100s is ~$7/hr on AWS; 10x1080ti is ~$1.3/hr on Vast.ai.)
- michaelbuckbee 8y agoStolen ones are easier to do reverse image detection on and expose as fraudulent. I see this a lot on Twitter - bots pull a mix of stolen profile pics, bios, etc.
- kzrdude 8y agoPossibly ethics and law (personal rights to the photo)?
- jerf 8y agoI'm seeing some characteristic artifacts in most of these pictures. A hair halo floating just outside of the head is pretty common, and there's a sort of rainbow fringing that was very common in the deep dream postings that I'm still seeing popup... ... but all, or almost all, of these would be irrelevant at a profile pic size. At that size, assuming these aren't just recapitulations of the training data (and I assume they aren't) this technique appears to be 99%+ successful. Also, look at the non-face stuff. Some backgrounds are just "incredibly blurred vaguely landscapy stuff", which is plenty realistic, but I've seen the algorithm attempt wood grain, which went poorly. I've seem some bizarre patchwork backgrounds, and one picture had a person cut off to the right like a single photo trimmed from a family photo, and the cut-off person was some sort of SCP-monstrosity mercifully cut off by the edge of the photo. Still, the success is impressive. The failures are definitely going from "in your face" to "easy to ignore/miss". Fix up the training data a bit and this'd be a profile pic machine.
- Loughla 8y agoEvery one of these pictures has something 'off' with them. But it takes a while to notice. My first three - the teeth were odd, there were small, regular rectangles out of the teeth. Then it was the eyes. Specifically the iris was the wrong shape and had too much glare from what I assume is a camera. Every single picture, if you really look at it, is disturbing for reasons you can't pick out. It's definitely hitting the uncanny valley. It's juuuust human enough to blend, but not human enough to avoid the creeping feeling of dread. But that being said, if I'm cruising forums and see this in a thumbnail size, I'm not going to be able to pick out that it's not a real person.
- vbuwivbiu 8y agothey're locally plausible but globally everything's slightly wrong: the measurements of features, the mixture between high-resolution and sudden blurriness, the occasional warping effect, the shifting perspective, the eyes don't sit in the skull correctly, the hair seems to be intersecting the forehead sometimes, every area seems to be located in a different space & there's no three-dimensional coherence to it
- 8y ago
- deleted 8y ago[deleted]