10 ms·
Yes, trying to solve this problem by creating a definition of "misinformation" sufficiently precise to act on it for all possible articles, then trying to remov
by jerf 10y ago
Yes, trying to solve this problem by creating a definition of "misinformation" sufficiently precise to act on it for all possible articles, then trying to remove it somehow is probably an AI-complete problem. If it's not AI-complete it's probably just plain an ill-formed question. That's before we ask questions about the biases that get embedded into the misinformation detector.
This can't be fixed at Facebook scales by building a platform that so highly incentivizes low-quality content of all kinds, then trying to stop the content so late in the cycle. The entire incentive structure has to be rethought. Unfortunately, that's probably a problem that Facebook is literally incapable of solving without going out of business, because Facebook the corporate entity is that incentive structure. To fix Facebook requires Facebook to become not-Facebook.
- DanielBMarkham 10y agoYes. We're talking about a platform that at it's best is birthday wishes, vacation and cat pictures. It's running on a paid content model, with advertisers selling through viral videos and click-bait. It's good not to expect too much out of it.
- Bud 10y agoWe're actually not; that's simply false. No, Facebook is not "at it's best" [sic] when it sticks to birthday wishes and cat pictures. It's actually at its best when it is truly social, in all senses of the word. When it facilitates real communication on real issues across a broad spectrum of people. When it spreads information, not misinformation.
- __jal 10y agoNot trying to speak for the original poster, but what I took away from the argument is that when FB is "truly social", involving real issues, the potential rewards are sufficiently high that misinformation becomes valuable, thus dangerous. When it sticks to birthdays and cat pictures, there's no incentive to go hostile. Think of it as being somewhat similar to the arguments about the Flash Crash regarding HFT and liquidity: that HFT is great for liquidity until you need it, at which point it goes away[1]. I agree with others that detecting misinformation in the general case likely requires a theory of mind, and so something approaching "real" AI. I also agree that FB has a serious problem on their hands. And I'm so very glad I don't use it. [1] I advance no comment here about the correctness of that; just a comparison to illustrate what seems like an overlooked point.
- taurath 10y agoThis is the same as reddit. As social platforms get larger they starts diverging from their original userbase (programmers/geeks for reddit, college students for facebook) to apply to a wider and wider audience. Eventually the wider audience starts to look a whole lot like the demographics of a whole country (or maybe the world), and it becomes a platform with as many arguments as society in general. The solution to not becoming a battleground which is inherantly destabilizing to the platform is to not grow, or only grow in a single direction. State up front what your targeted user base is and keep to them. NeoGAF as a "gamers only" forum will survive a very long time, for instance. Facebook has sidestepped it by becoming a personal community for each user, but whenever they try to connect that personal community to the wider world through "shared" news, "shared" trends etc that are not personalized it causes a big ruckus.
- DanielBMarkham 10y agoSocial communication is in-person, face-to-face communication. It's not moving bits around over an http interface. I love idealists, but it's time to take an honest accounting of the differences between the promises of the internet and the actuality.
- Bud 10y agoNot anymore. I'm sorry, but that that view is now obsolete. The fact is that large and increasing quantities of our social communication now occur online. I'm not claiming this is salutary or calling it a good thing. I'm just stating the fact.
- DanielBMarkham 10y agoI have no doubt that a lot of social information is being transferred in a new way, much the same as the introduction of the telephone allowed a lot of social information to be transferred in a new way. My point is that true socializing and socialization are human, not digital experiences. Not trying to be pedantic here. It's just important to sort out the terms used if any analysis is going to be useful. What's happening on facebook is not social. It's bits of data around being social. Different thing entirely. Perhaps we need a new term for whatever it is, but whatever we call it, it's not the same as face-to-face real socializing with real people.
- severine 10y agoAren't Bud and you socializing right now? Hell, I even feel I'm socializing a bit with you, how wrong am I?
- DanielBMarkham 10y agoAre you picking on me? Making a joke that we share? Challenging me to come up with a retort? Asking me to join in to a shared humorous narrative? Giving me a friendly jibe about an error or weakness you perceive? We assume positive intent online because otherwise we get flame wars, but there's a helluva lot of body language and inflection that can take the comment you made and make it mean a dozen things. All of that is lost. And all of it is important. In addition to the nuance, would I know severine if I saw them on the street? Miss them if they died? Remember the nice way they did X everytime we met? We are exchanging written opinions and statements, yes. These exchanges also occur in social interactions. But we are not socializing. There's no bond here that's become stronger, no subtle nuance or interplay that we're managing at a subconscious level. For all either of us knows, the other one is a bot. Or an alien. There's no humanity here.
- daveguy 10y agoIf it is truly social then it will spread misinformation like wildfire. That's what people do -- gossip game magnified. That said, maybe Facebook is best when it is just spreading obviously unimportant content (in the sense of national and global affairs), like birthday wishes and cat pictures. No harm if the cat is implicated in wild conspiracy theories. It's not the cat pic sharing that is paid for by entities with motive and interest in spreading misleading messages.
- emp_zealoth 10y agoWhen Facebook is at it's best is taking money from nefarious actors and fucking up democracy In Poland, for good half year before our presidential election, then a year after I was getting obviously paid for posts from dozens upon dozens of right wing extremists. I am left-centrist (although my dad jokes at me that im a bolshevik). I don't have many friends who skew righ-wing either. Yet, there was my wall, chock full of sensationalist bs, for over A YEAR Wonder how much money Facebook earned in that time just from sad little Poland
- ethbro 10y agoFacebook completely controls the presentation priority, no? Bolt a Watson-like truth scoring system on to evaluate content and use the resulting confidence to boost or bury content in other's feeds. It would absolutely have to be automatically generated, but it doesn't seem impossible (just much harder NLP that Watson playing Jeopardy).
- dasil003 10y agoIt seems to me the hardest part would be separating truthiness from virality. How do they seed legit sources in the current media climate of racing to the bottom for eyeballs.
- ethbro 10y agoIsn't this essentially the problem Google's been solving with continued iteration on PageRank? From an untrustworthy collection of input relationships, how do I produce the most reliably correct output?
- dasil003 10y agoNo because popularity does not equal truth.
- ethbro 10y agoIt doesn't? Because in the sense that popularity is "agreement with consensus scientific opinion" then it absolutely does.
- dasil003 10y agoWell, to be more specific about what I mean is, Google's algorithm is successful if it finds the pages that people find valuable. It's sort of baked into the value proposition that the end user will be able to gauge the quality of results, so there is a sort of feedback loop. The problem with misinformation is there is no in-band signal for Google about its truthiness. I suppose there heuristics you can use related to fact-checking quality of certain publications, etc, but it's much trickier than general perceived quality. Nevertheless, I agree that if anyone can do it algorithmically, it would probably be Google.
- nostrademons 10y agoThis is a problem with human wetware - there are several cognitive biases [1][2][3][4] that make people engage more strongly with ideas that fit their preconceptions and discount ideas that don't. Add information-sharing to the mix and the aggregate effect you get is large information cascades that fracture the population into tribes that believe things not necessarily because they're true, but because they are stated early, vehemently, and frequently. Remember that evolution favors individuals who survive & gain status, not those whose representation of the world is true. Someone who is right but killed for it (eg. Copernicus) is still dead. The fix is for people to be aware of these cognitive biases in themselves, to actively seek out information that differs from their preconceptions, and to challenge inaccurate information (with evidence!) when presented with it. You can't outsource this to a communication platform, because it's inherently less comfortable and more effort for the reader, and the reader will just go to a competing communication platform that makes them feel better. [1] https://en.wikipedia.org/wiki/Illusory_truth_effect https://en.wikipedia.org/wiki/Illusory_truth_effect [2] https://en.wikipedia.org/wiki/Confirmation_bias https://en.wikipedia.org/wiki/Confirmation_bias [3] https://en.wikipedia.org/wiki/Bandwagon_effect https://en.wikipedia.org/wiki/Bandwagon_effect [4] https://en.wikipedia.org/wiki/Congruence_bias https://en.wikipedia.org/wiki/Congruence_bias
- Florin_Andrei 10y ago> The fix is for people to be aware of these cognitive biases in themselves, to actively seek out information that differs from their preconceptions, and to challenge inaccurate information (with evidence!) when presented with it. You are right, but I hope you are aware that this would require a giant leap to an essentially superhuman state of rationality and clear thinking for a vast majority of people. Just stop for a moment and look around you. Is that how most people actually function in this world?
- intended 10y agoHah! It's worse. As a kid I learnt this and tried to be as rational and aware of my fallibalities as possible. That makes you an alien to normal human beings. Conversation becomes impossible, processing fast enough becomes impossible, and the penalties for acting weird and communicating weird are huge. Instead you need to find a way to act in a manner that allows you to blend in with people.
- Florin_Andrei 10y agoIt's almost as if solving the problem of truth is antithetical to the notion of having a for-profit entity be the main channel of [legit|mis-]information in our world. It's almost as if the way we understand and use money has hardened into a giant screwball of lies, base instincts, and perverse incentives. Almost.
- deleted 10y ago[deleted]
- Bud 10y agoThere is no need to create a Grand Unified Theory of misinformation, here. This problem isn't that hard. You filter this stuff and rank it by its SOURCE, not by the content of individual articles. It's not hard to figure out which online sources are pushing out most of the abjectly-bad propaganda, and de-rank them.
- LoSboccacc 10y agothis assumes their interest is in being fair, but I suspect their goal will gravitate mostly toward 'not being sued/investigated' which may very well create a selection bias.
- cpr 10y agoSorry. Most of the official sources in this recent campaign were dead wrong on a lot of issues, mostly because of their own massive biases.
- kbenson 10y agoAre you referring to wrong when they described what they thought was going on, which contains a large amount of opinion, or wrong on the facts as they exist? Facts can be presented in a biases way (generally through omission of other contextual facts), but if what is said is factual, at least that bit of information is still correct. If combining multiple sources to generate a grouping of facts, that presentation bias way well disappear. If system weeds out people that present opinion as fact, all the better.
- bmj 10y agoOr opinions can be presented as facts, or at least presented in a way that makes it hard to tell if it is reporting or analysis.
- hueving 10y agoFrankly papers that lie through crafted contexts are much more dangerous because they give a false sense of authority due to their correctness at the micro level but incorrectness at the macro level. Imagine I develope a newspaper that only reports crimes committed by a particular race and I excruciatingly fact check every incident and highlight when they are uneducated (but don't mention education otherwise). What will result is one of the biggest macro lies that will fuel racism through its broader message while everything will be perfect to a fact checker. This would rank perfectly in such a system while broader newspapers would get hammered for messing up picture captions and confusing Airbus A319s with 737s.
- darawk 10y agoI think I would argue that this is beyond an AI-complete problem, it is an unanswerable problem. For instance, consider the following spectrum of ideas: - The earth is flat - 9/11 conspiracy theories - Barack Obama was born in Kenya - Anti-vax - Climate change denial - Anti-GMO - Denial of underlying quantum randomness in the universe - The Clinton Foundation has been or is involved in some shady dealings - Muslims want to implement Sharia law in Europe - The minimum wage decreases employment - Donald Trump has sexually assaulted a number of women - Monetary policy impacts the real economy - The sun will, on balance, probably rise tomorrow I've sorted this in a (rough, personal) order of increasing plausibility / conformance with facts. Where is the line between misinformation and alternative information? As a human, it's pretty unclear to me.
- hawkice 10y agoMan, it must be me, but you ranked "Monetary policy" WAY more likely than I would (rates near zero for so long doing so little must at least put SOME doubt in your model), and "denial of quantum randomness" way less credible than I see it as. Like, man, reasonable people can disagree about pilot waves and many worlds. Are there some confusing, emotionally laden, difficult questions of fact in there? Yes. Are some things ultimately unknowable (like what people want, which involves scrying into their minds)? Yes. These, as it turns out, are not the things I can't help but be side-tracked on. I'm diverted by you claiming monetary policy has an effect with nearly the certainty of the sun rising.
- darawk 10y agoHaha, sorry I knew this list would cause this sort of trouble. I'm a big believer in pilot wave theory myself, it's just very much not the 'mainstream' view. And I didn't mean to imply that the last two were close together, either. I do think monetary policy probably has some effect (whether we understand or can model that effect is another matter), but I didn't mean at all to imply that it was anywhere near the certainty of the sun rising, it just happened to be the closest :). I think perhaps we disagree more about the probability of these two: - The Clinton Foundation has been or is involved in some shady dealings - Muslims want to implement Sharia law in Europe Than the other two. I think both of those are, in some sense, almost certainly true. There are Muslims who want to implement Sharia law in Europe. The Clinton Foundation has been involved in transactions that at least have the appearance of moral uncertainty. The headlines that I listed are just overly strong statements/generalizations of those (IMO undeniable) facts.
- lkrubner 10y agoHow would AI resolve religious issues? The Jews say they are waiting for the Messiah. The Christians say the Messiah came once and will come again. The Muslims say there is only one God and Muhammad is his Prophet. Which of these groups is correct? I would love to see the AI algorithm that can finally settle this issue! Seriously, mad props to the programmer who writes that code!
- kisil_reboot 10y agoFortunately, you don't really have to solve that problem. It would be sufficient to assess claims of actual fact about the actual world. I think the first step in writing the classifier would be to write something like float IsStatementAboutFacts(string statement); // Returns confidence estimate
- lkrubner 10y agoYour statement is that of an atheist. You don't seem to realize that many of the followers of these religions believe their assertions to be factual in every way. When I got off the subway today, at the Port Authority, in New York City, there were 2 women, holding up signs about Jesus. One of the signs literally said "Historical fact: Jesus rose from the dead".
- drumdance 10y agoTo me that's less of an issue than a statement like "if Trump is elected Jesus will return."
- qb45 10y agoThis statement is true because Jesus promised to return regardless of election results :)
- EdHominem 10y agoRight, they have a few historical claims. But none of them have any proof for those claims and their confidence is off the charts. Some of their statements pass the first filter, far fewer pass the second.
- thecrazyone 10y agoWhy not do what Twitter does and let the floodgates open I.e. Do no filtering? I'm however doubtful that a "successful" social network would learn from struggling one. Well C'est la vie.
- inimino 10y agoIs it established that that is in fact what Twitter does? I see something non-chronological on Twitter and it hasn't been clear for years what criteria are used.
- cmdrfred 10y agoThey also banned the Hillary for prison hashtag I believe. The supporters had to spelling it wrong in order to get it to trend again.
- deleted 10y ago[deleted]
- posterboy 10y agoindeed, it would take more than likes and shares, just an election of just votes and promisses is insufficient, yet, there we are.