4 ms·
The problem is much more difficult than creating a classifier. The purpose of filtering news is to control the impact, not to control the tactic. The last time
by jwtadvice 10y ago
The problem is much more difficult than creating a classifier. The purpose of filtering news is to control the impact, not to control the tactic. The last time Facebook issued a surge to control 'spam' posts for the same government concerns they seek to deal with "fake news" today, they took out pro-Sanders articles, censored sharing of the Snowden documents, prevented people from linking to Wikileaks, and shut down Facebook organizing for May Day protests.
Facebook regularly censors and directs conversation online around the world to the whims of various regimes and administrations, but it's just not easy "use machine learning".
The issue is that machine learning is inherently modeled to solve decision problems in spaces that separate high level 'features' from low level observations. The study and practice of machine learning thus far has modeled noise, uncertainty and complex state spaces.
However, machine learning classifiers do not themselves have a concept of adversarial data: this led, for example, to spammers who would "poison" machine learning classifiers by biasing them to learn the wrong things, so that they could get their spam through. Similarly, not too long ago, Microsoft put a conversation bot on the web that 'learned the wrong things' because people approached the bot in an attempt to trick it.
Facebook's requirement for battling unsanctioned opinions is that it solves this problem - it hasn't been solved yet. Facebook needs to continuously monitor the adapting activity and patterns of people who are trying to say things that governments and Facebook customers don't want people saying.
Basically: machine learning doesn't adapt but people do, and naive attempts to get machine learning to adapt make it vulnerable to being tricked, because classifier theory inherently has no concept of adversarial data.
- mathperson 10y agoumm no!...I don't know too much about this sub-field..but there are machine methods designed explicitly for adversarial data. it even has a wikipedia page! I don't know if facebook's methods implement any of this yet..but your statements about machine learning not modelling this just ain't so. https://en.wikipedia.org/wiki/Adversarial_machine_learning https://en.wikipedia.org/wiki/Adversarial_machine_learning http://www.cs.virginia.edu/~evans/ http://www.cs.virginia.edu/~evans/
- jwtadvice 10y agoGreat resources! It's important to understand that these approaches are on the leading edge of research, and represent unsolved problems!
- mathperson 10y agoyes precisely! i'm sure Facebook's methods are very susceptible to these types of attacks. Hopefully they still are in 6 years and we can get jobs fixing this for them lol. I also really recommend this book https://www.amazon.com/Trust-Me-Lying-Confessions-Manipulator/dp/1591846285/ref=sr_1_1?ie=UTF8&qid=1479519844&sr=8-1&keywords=trust+me+im+lying https://www.amazon.com/Trust-Me-Lying-Confessions-Manipulato... The type of attack is a lot more oldschool but nonetheless, pretty effective.