3 ms·

I thought the same thing. I wonder if there could be a way to have you submit a posed picture (to verify that it was taken live) and then use facial recognition

I thought the same thing. I wonder if there could be a way to have you submit a posed picture (to verify that it was taken live) and then use facial recognition to verify your face is in the content. It would probably be hard to do all that on device. It would also be a lot of hurdles to place in front of users, the vast majority of whom are just legitimate victims. But if they don’t do something like that, I could see submitting all the Pepe the Frog memes in an attempt to stop the proliferation of material that FB probably should have been stopping anyway.

dcallies 5y ago
It’s a real challenge - you can try and do more pre-processing on a submitter’s device to try and avoid mistakes or malicious use of the system. The big limitations are: 1. How much processing time can you put on what might be a mobile phone - it’s using MD5 for Videos, but StopNCII did also try other things that were just too slow for phones. 2. StopNCII chose to do verification on platforms after a match rather than do it up front to prioritize the privacy of the user. This decision came after a lot of feedback from victims and experts who represent them. There are all sorts of techniques you can use to process server side (thus saving the person’s phone’s CPU), but it deliberately doesn’t retain enough context to make them viable.