3 ms·
So, the Met wants to train image recognition AI to find child abuse images? I'd be surprised if there aren't some interesting ethical questions around this. To
by YeGoblynQueenne 9y ago
So, the Met wants to train image recognition AI to find child abuse images? I'd be surprised if there aren't some interesting ethical questions around this.
To begin with, the way image recognition algorithms work -they learn from examples- to train an image recognition AI to identify images of child abuse you'd have to provide it with a substantial database of such images. I'm pretty sure that's illegal, although of course the Met probably has some sort of exception for the purpose of fighting crime. But, they still have to keep around a big database of child abuse images - and update it regularly, to do this job. It's kind of... icky.
Then again, what about victim protection? Besides the fact that keeping such a database is risky because it can always fall into the wrong hands (it only takes one misconfigured database server) it's also a characteristic of the most advanced image recognition algorithms (conv-nets) that their models can be used to generate new images of the kind they've learned to identify. So presumably, if the model itself fell into the wrong hands, someone could start generating new child-abuse images from it (low-fidelity and not really very useful, I imagine, but still).
So I wonder if the Met has addressed such ethical issues, anywhere.
- coding123 9y agoLaw enforcement already has tons of child porn lying around used primarily to frame people. Of course similar to drug planting it is extremely hard to defend because no one wants to risk defending someone charged with that. There are exceptions and I'm not saying people like Jared from Subway aren't guilty. There are many many many lesser known individuals that are hushed up using child porn. So I'm basically saying there is no ethical problem (from their perspective) because feds/cops already deal with this all the time and plant this on people like drugs.
- gamblor956 9y agoYou're wrong on literally all points, but why let the truth get in the way? Law enforcement does collect images that have been traded. They do not use these to frame people, unless you are referring to the honeypot sites that they have taken over. They maintain these sites hoping that CP collectors will continue to download images of their own volition and that they can they trace the IPs to a real-world address. There are many many many lesser known individuals that are hushed up using child porn. Citation needed. This would the first I've heard of CP being used to frame people by law enforcement. It happens, though very rarely, that some people try to frame innocent individuals... So I'm basically saying there is no ethical problem (from their perspective) because feds/cops already deal with this all the time and plant this on people like drugs. So I'm basically saying there is no ethical problem because feds/cops already deal with this all the time, but they don't frame people. They let the idiots hang themselves. And by the way, my source is that I used to defend people like this when I was a public defender. What's your source?
- ravenstine 9y agoWho wants to be the developer to train a neural network on child porn? You couldn't pay me all the money in the world twice over to take that job.
- deleted 9y ago[deleted]
- fragmede 9y agoThe only thing new is that the child pornography pictures are being fed to an ML model. The police have been keeping and distribute photos of icky things for as long as pictures of murdered people has been useful as courtroom evidence, and Interpol and the FBI have kept a database of child pornography since the early days of microcomputers to track down rings of child pornographers. As far as generating new kiddie porn, before there were ML models, there was Photoshop, and that first released in the 90's. That there are more advanced methods of generating child pornography is not interesting or new under the law (depending on your jurisdiction). "Fun" fact: Facebook/Instagram/Snapchat have giant repositories of (tagged!) child pornography however before we get our pitchforks out, it's used to keep child pornography out of the system. Unfortunately with current technology there's not really a realistic way around having the actual images; hashing only goes so far, and just like (performant) homomorphic encryption, if you were able to come up with a way to do this without actually needing the pictures, the world will beat a path to your door.
- stordoff 9y ago> But, they still have to keep around a big database of child abuse images - and update it regularly, to do this job. IIRC, they already do this, for tracking the distribution and source of such images. > It's kind of... icky. No disagreement there. > their models can be used to generate new images of the kind Tools like Photoshop can already do this, and likely to a higher quality than running a conv. net in reverse (so to speak), so I doubt that's a big concern.