4 ms·
This part is troubling: In May 2014, Dave Willner and Dan Kelmenson, a software engineer at Facebook, patented a 3D-modeling technology[1] for content moderati
by hackuser 10y ago
This part is troubling:
In May 2014, Dave Willner and Dan Kelmenson, a software engineer at Facebook, patented a 3D-modeling technology[1] for content moderation ... First, the model identifies a set of malicious groups - say neo-Nazis, child pornographers, or rape promoters. The model then identifies users who associate with those groups through their online interactions. Next, the model searches for other groups associated with those users and analyzes those groups "based on occurrences of keywords associated with the type of malicious activity and manual verification by experts." This way, companies can identify additional or emerging malicious online activity
It's not hard to imagine how this could be misused: Automated guilt-by-association, and within 3 degrees of separation, triggering investigation by authorities (corporate or otherwise).
EDIT: And also this tool of automated censorship, though I doubt it will surprise many HN readers
PhotoDNA works by processing an image every two milliseconds and is highly accurate. ... Then PhotoDNA extracts from each image a numeric signature that is unique to that image, "like your human DNA is to you." Whenever an image is uploaded, whether to Facebook or Tumblr or Twitter, and so on, he says, "its photoDNA is extracted and compared to our known ... images. Matches are automatically detected by a computer and reported ... for a follow-up investigation"
Currently used for child exploitation images, but for what else too and by whom? They add that it's being applied to something more political:
Farid is now working with tech companies and nonprofit groups to develop similar technology that will identify extremism and terrorist threats online - whether expressed in speech, image, video, or audio.
[1] http://www.google.com.gh/patents/US20080256602 http://www.google.com.gh/patents/US20080256602
- CM30 10y agoThis is a really good point, and this sort of thing could well be happening already. There has already been controversy over negative posts related to immigration being removed from Facebook due to a deal with the government. And there's already been talk of people inside Facebook asking whether they're 'doing enough' to stop a Donald Trump presidency: http://gizmodo.com/facebook-employees-asked-mark-zuckerberg-if-they-should-1771012990 http://gizmodo.com/facebook-employees-asked-mark-zuckerberg-... As well as cases where people were visited by police after making right wing comments online: http://www.breitbart.com/london/2016/04/07/police-raid-social-media-posts/ http://www.breitbart.com/london/2016/04/07/police-raid-socia... (Yes, I know it's from Breitbart, but the point still stands) And there's a lot of talk about Twitter censorship, blockbots blocking people based on what accounts they follow rather than any actions and all that stuff. Similar systems are already being abused by social networks, and this type of technology will only make cases like this more common.
- hackuser 10y agoIt would be great to have more solid data; I feel that speculation only clouds the issue. > Yes, I know it's from Breitbart, but the point still stands Not if you don't believe Breitbart