3 ms·
Has anyone tried training a neural net to distinguish between photographed vs AI generated images? Of course, you will need to remove exifs or other metadata,
by tsycho 3y ago
Has anyone tried training a neural net to distinguish between photographed vs AI generated images?
Of course, you will need to remove exifs or other metadata, but this sounds like the kind of domain that NNs are good at.
- moofight 3y agoyes, and it's quite challenging for instance => https://sightengine.com/detect-ai-generated-images https://sightengine.com/detect-ai-generated-images
- HPsquared 3y agoIsn't that basically how the image generation models themselves work? By refining the image until it can't distinguish it from a "real image".
- jncfhnb 3y agoThat was trendy for a while but is no longer the primary method
- ok123456 3y agoYes. Trying to sell an "AI detector" is a fool's errand since this is how adversarial networks (the hot model from two hype cycles ago) are trained. The only use of the "AI detector " is to tune the model so that the detector is uniformly random.
- mindcandy 3y agoThis is true for explicitly adversarial actors. I can imagine a serious-business misinformation group investing the money required to train up a generator designed to defeat automatic detection. For everyone else though, the people making common tools everyone uses explicitly want their images to be easy to automatically ID as fake. And, the users largely prefer it that way too.
- erhaetherth 3y agoAs a user, I don't really care one way or the other. I'm not trying to trick anyone. I also don't care if they can readily tell if my image was AI generated. I don't post much media though. If I did, I'd probably use it for a game. And if it's a game, does it matter if I touched it up in Photoshop vs StableDiffusion? There's going to be some processing either way to get the art asset I need. The toolmakers might have a mild incentive to tag images generated with their tool to prevent too easily creating these 'fakes' or just for analytics purposes so they can see how their output is spreading. But regardless, it's a fools errand like the other poster said. Anyone that is serious about tricking the mass media will strip out the watermark or use a different tool.
- ok123456 3y agoIt's 2024. Everyone is an adversarial actor.
- spacemanspiff01 3y agoWhat was the hype-cycle between GANs and diffusion?
- nineteen999 3y agoCryptocurrency.