10 ms·
Partisan Bias Diminishes When Partisans Pay
- ajuc 13y agoImagine you honestly believe in intelligent design. You probably know most people believe the opposite, so when you encounter poll designed by people you don't know you assume they believe evolution theory is true, so if you want to win money you say whatever it takes, no matter what you believe. So IMHO this experiment measured how well people predict what experimenter thinks is correct, and not how people beliefs change when incentivized. To control for this divide the group that gets money into 2, and say to one subgroup you're republican think-tank, and to the other you're democrat think-tank, and compare the results :)
- jbooth 13y agoIn your metaphorical question, there is actually a correct, factual answer and it's not intelligent design.
- DennisP 13y agoI'm guessing ajuc agrees with you, but it's completely beside his point.
- ajuc 13y agoYes.
- jbooth 13y agoI'd say that admitting something is generally accepted as true (which you're agreeing the respondents did) is the first step towards admitting that it might actually be true. The truth isn't subjective, and it seems that the survey elicited that from people to an extent.
- samatman 13y agoThis is certainly a factor that needs to be controlled for. To me, the most interesting part of the study is that, by rewarding correct answers and confessions of ignorance, they got the most accurate results. I would like to see that effect studied for its statistical significance, and for the technique to be applied to polling if it proves to in fact increase the accuracy of the signal.
- samatman 13y agoSomething like 'This survey asks questions about facts and opinions. Your compensation depends on correct answers to factual questions. Answering "I don't know" to a factual question is worth N% of a correct answer.'
- jessriedel 13y agoThis is an additional complicating factor, but it's not some fundamental problem with these type of studies. There are facts that essentially all people agree to be true when provided with all the information ("objective facts"), and the question is how people's subjective beliefs about these facts are correlated with political party when these people do not have ready access to all the information (as we usually do not).
- btilly 13y agoImagine you honestly believe in intelligent design. You probably know most people believe the opposite, so when you encounter poll designed by people you don't know you assume they believe evolution theory is true... That's a poor example that demonstrates your own ignorance about the USA as a whole. In the USA more people believe in creationism (God created everything 6000 years ago) than intelligent design. And far more people believe in intelligent design than evolution. See http://www.gallup.com/poll/155003/hold-creationist-view-human-origins.aspx http://www.gallup.com/poll/155003/hold-creationist-view-huma... for the numbers. It is worth noting that belief in evolution is within a factor of two of belief that Obama is a Muslim (about 20%) and belief that Elvis is still alive (around 7%).
- ajuc 13y agoYep, I assumed I encounter representative portion of USA on internet, apparently I was very wrong. USA I am disappointed. Maybe thinking global warming is a scam would be better example. EDIT: on the other hand I never stated the poll takes place in USA :)
- btilly 13y agoMaybe thinking global warming is a scam would be better example. Better, yes. Good? Depending on how you ask the question, between 2/3 and 3/4 of Americans believe in global warming. However that figure drops to under half of Republicans. (Lest you think I'm merely insulting Republicans here, let me point out that most Democrats do not understand what economics 101 says about the effects of rent control. Both parties show a lot of ignorance about the world, merely different parts of it.)
- mmanfrin 13y agoYou are missing the forest for his tree example. He was using creationism as a means to illustrate a point: that the responders probably tilted their responses towards what they thought the researchers believed instead of what they themselves believed.
- 13y ago
- Sambdala 13y agoThis effect doesn't go away entirely though (as was admittedly stated in the article). In political betting markets, you can almost always find a +EV bet by betting on the most likely candidate to win because those who are on the side of the underdog always overprice their candidate's chances, some of this can be attributed to buying into the neck-and-neck rhetoric. http://en.wikipedia.org/wiki/Favourite-longshot_bias http://en.wikipedia.org/wiki/Favourite-longshot_bias
- twoodfin 13y agoBut is there any way to exploit this effect? I am a big believer in federalism and even further devolution of power to smaller polities. It's a good tradeoff of liberty vs. society: If you don't like the way your city is run, it's a lot easier to move to the next town over than it is to leave the country. As a result, despite being a pretty laissez faire guy, I'm much more tolerant of, say, San Francisco banning plastic shopping bags than if the EPA were to do so. It also has the pleasant result of giving voters much more direct control over the way the government that affects them most is run. Their vote really does matter; it is, in many ways, a "bet" on which policies will provide the best outcomes for them.
- crusso 13y agoit is, in many ways, a "bet" on which policies will provide the best outcomes for them Which is why many people shy away from it. Voters don't want to be responsible for their votes and their actions. More and more we see the populace wanting to hand over control of their lives to someone else. They live vicariously through celebrities and movies while eagerly voting to redistribute wealth via the Nanny State. Occupy Wall Street was right in tune with this no-repercussions thinking. Capitalism was squarely in the OWS crosshairs since Capitalism is the best way we have of keeping track of good and bad decisions. The forecast is for more of the same. The TEA Party was the last gasp of a desire of a minor segment of society that wanted to reduce the size of government and increase individual Liberty. They've pretty much been shouted down by the thought leaders with the biggest megaphones in our society.
- scotch_drinker 13y agoThe juxtaposition of this comment on an article about how bullshit levels go way down when bullshitters are financially responsible for their statements practically blows my irony meter up. Capitalism was squarely in the OWS crosshairs since Capitalism is the best way we have of keeping track of good and bad decisions. Sigh. OWS was protesting the fact that the government handed over billions of dollars to Wall Street banks while middle America got shafted. Either you don't know what capitalism is or you're just spouting talking points. Or possibly both. OWS and the Tea Party were the opposite sides of the same ideological coin. They went about it different ways but they were both concerned with fairness and ending governmental oligarchy.
- DanielBMarkham 13y agoAnother commmenter hit this, but it deserves underlining. You can't ask the question of whether certain statements, to the people giving them, are matters of fact or political opinion, and then have "correct" answers which are provided by others. If you have correct answers, you already know that certain opinions are based on error. The only thing you can do with such an experiment is measure how well people can guess what the judges think to be true. As it turns out, they did fairly well. I could care less about this example, but let's take the WMD question. Old WMD was found in Iraq. http://en.wikipedia.org/wiki/Iraq_and_weapons_of_mass_destruction#Chemical_Weapons_Recovered http://en.wikipedia.org/wiki/Iraq_and_weapons_of_mass_destru... A partisan wouldn't argue the facts. He'd simply point out that, depending on how you phrase the question, the answer could be interpreted either way. The questioner has to rephrase "After the second Gulf War, were WMD found that were created in between the two wars?" This easily goes to extremes, and questions end up being extremely detailed in order to resolve matters of "fact" This is why the role of fact-checker is a waste of time. Most all of the time, politicians aren't lying, they're simply phrasing things in enough ambiguity to create the desired impression. (This actually works for me as "bullshit", but it's not lying, and it's not giving out factual errors)
- jessriedel 13y agoI find this line of argument very unconvincing. Would you apply it to the question of whether inflation and/or unemployment went down during Regan's term? Do you really think this has anything to do with the precise definition of those quantities?
- jeffdavis 13y agoI think you picked a poor example, because inflation is hard to measure and hard to define. I know lots of people who argue with our current definition of inflation using reasonable-sounding arguments.
- dyno12345 13y agoInflation is only hard to define for those who want there to be something called "inflation" that predicts recessions and is caused by the government. Naturally it's hard to find anything to nail down within those parameters. In the rest of the world inflation equals price increases and there are standard metrics that have been used for decades. Most economists would probably agree that those metrics have several well-known flaws. But we can agree that inflation according to the definitions and metrics that 99% of the world uses did or did not change by X or Y in a given time period.
- nijk 13y agoGiving people a chance to save face, with "I don't know", deflates partisanship. USA cold learn from eastern cultures about this.
- sesqu 13y agoA major problem with this experimental setting, and the proposal that bets signal belief, is that they ignore the system the bets are placed in. As students observe, "the right answer" depends on who's doing the judging. Most students have learned to answer not what they believe, but what they believe the examiner wants to hear. This is a fairly important skill, as many examiners are incapable of asking even unambiguous questions. On the other side of the equation, information signalled in a bet is tainted by the signaller. The answer they give is not necessarily their "honest belief", but rather what they wish to signal as such. Much of high-stakes information, such as in politics, commerce, and warfare, is valued opaquely, for the purpose of enticing onlookers to act on the bets that they do see, which can be counter to the interests of the bettor.
- JoshTriplett 13y agoGetting people to make decisions that directly impact them is a good way of figuring out which beliefs they actually use to predict the behavior of the world and which beliefs they only profess but in some way know are false. Consider someone who claims "I have a dragon in my garage.". When someone asks to test that claim by looking, you say it's an invisible dragon. When they then say they'll listen to the dragon breathing, you say the dragon doesn't need to breathe. If they offer to throw a bag of flour over it and see the shape of the flour-covered dragon, you say the dragon is permeable to flour. Despite saying you have a dragon in your garage, all your predictions are based on not having a dragon in your garage. If you actually thought you had a dragon in your garage, you'd say "sure, let's see"; you should be perfectly willing to test that claim and accept the result. (Credit to http://lesswrong.com/lw/i4/belief_in_belief/ http://lesswrong.com/lw/i4/belief_in_belief/ for the dragon example.) The same lines of experimental questioning can generally distinguish between "I truly believe this and use it as a model to predict how the world works" and "I profess this but when it comes time to predict how the world works I do so using a model that actually works.". On the other hand, if you build a system that rewards people for how strongly they profess their beliefs, and how much confirmation and support they get from others professing the same beliefs, you can give strong positive reinforcement to beliefs that do not model the world.
- msg 13y agoThere is a problem with the invisible dragon. If your believer is aware that the strongest alternative to their belief that there is a dragon in the garage is that there is no dragon, they will tailor their explanations to your perspective. That doesn't prove they share your perspective deep down if they could just admit it to themselves, it just means they understand you.
- JoshTriplett 13y agoIt doesn't matter whether they understand the other person's beliefs or not; the question is, what do they actually believe experiments will show about the world, before performing the experiments? If they truly expect that there's a dragon in their garage, they'll expect results consistent with having a dragon in their garage; if they don't actually believe that, they'll make predictions consistent with not having a dragon in their garage.
- joelthelion 13y agoToo bad there isn't anymore a great prediction market. This could be a nice opportunity for bitcoin.