3 ms·
You hear Facebook all the time saying how it "automatically blocks 99% of the terrorist content" with AI to the public and governments. Nobody thought to ask:
by mtgx 8y ago
You hear Facebook all the time saying how it "automatically blocks 99% of the terrorist content" with AI to the public and governments.
Nobody thought to ask: "How do you know all of that content is terrorist content? Does anyone check every video afterwards to ensure that all the blocked content was indeed terrorist content?" (assuming they even have an exact definition for it).
- shmageggy 8y agoAlso, how do they know how much terrorist content they aren't blocking (the 1%), since they by definition haven't found it yet?
- jaggednad 8y agoYes, they have a test set. They don’t check every video, but they do check every video in a sample that is of statistically significant size.
- varelse 8y agoI'm 100% convinced it can block 99% of all terrorist content that hasn't been effectively SEOed to get around their filters because that's just memorizing attributes of the training set data. Unfortunately, the world isn't a stationary system like these ML models (usually) require. I still get spam in my gmail account, nowhere near as much as I do elsewhere, but I still get it.
- fantasticsid 8y ago> Does anyone check every video afterwards to ensure that all the blocked content was indeed terrorist content? They might not, but they could sample them to be statistically confident?