7 ms·
> What’s stopping elites and elected officials from accessing the public opinion polling that social scientists use to understand what the public wants? > Rens
by whimsicalism 4y ago
> What’s stopping elites and elected officials from accessing the public opinion polling that social scientists use to understand what the public wants?
> Renshon: Absolutely nothing is stopping elites from using the same public opinion data ... it’s also not unusual for politicians to discount or dismiss public opinion polls when they don’t like the results
I am curious if we are reasoning from stable ground here. Are opinion polls actually representative of what public opinion is - and more importantly, how the public will vote?
It seems that on a lot of hot button issues - for instance, guns - opinion polls show considerable support for restrictions that simply do not manifest when there are actual referenda on the issue. Polling on guns tends to skew substantially to the left of the actual referenda.
- rayiner 4y agoA lot of political polling is poor and conducted in isolation. People consistently support addressing climate change, for example. What will they pay to address climate change? Less than $10/month: https://www.cato.org/blog/68-americans-wouldnt-pay-10-month-higher-electric-bills-combat-climate-change https://www.cato.org/blog/68-americans-wouldnt-pay-10-month-.... Most people support Roe. Meanwhile, most people oppose legalized second trimester abortions, which is guaranteed by Roe. With respect to gun—what people support and what they trust democrats enough to work with them on are two different things. A lot of issue polling is conducted by advocacy organizations and is useless. Pew and Gallup are some of the few organizations doing objective polling.
- mike_hearn 4y agoActually, even companies like Pew and Gallup have serious problems with poll accuracy. Beyond the well known issues with wording sensitivity there's a pervasive problem that they know about, but which isn't widely known by the general public, who tend to assume that professionally done polls are unbiased and accurate. I wrote an article about this last year [1] explaining the problem and providing references. The summary is as follows. The number of people who are willing to answer random phone calls by pollsters declined seriously over time to the point where almost all calls fail. As a consequence pollsters now rely heavily on panel polling, where people who are willing to answer polls are recorded and repeatedly re-polled over and over in return for trivial sums of money. This has created an enormous and unfixable bias problem, called pro-social or volunteering bias. It's exactly what it sounds like - the sort of people who are now being regularly polled are drastically more likely to be volunteers than normal people. This can be measured by polling panels on how many of them volunteer for things in their community and then comparing the answers against census results [2]: "While the level of voter registration is the same in the survey as in the Current Population Survey (75% among citizens in both surveys), the more difficult participatory act of contacting a public official to express one’s views is significantly overstated in the survey (31% vs. 10% in the Current Population Survey). Similarly, the survey finds 55% saying that they did some type of volunteer work for or through an organization in the past year, compared with 27% who report doing this in the Current Population Survey." This level of bias is extreme and unfortunately completely uncorrectable. It's inherent to polling the sort of people who are willing to regularly spend time filling out long forms in return for basically no compensation - you're getting a population of Ned Flanders style good neighbours who are, relatively speaking, obsessed with civic duty. That's why they're doing the polls - they think it's for the general good! Making things worse, panels get more dominated by such types over time because less volunteering-oriented people drop out at a higher rate. Thus a panel that might start out somewhat representative will become less so over time, and they don't really have a good way to control for that or even measure it. Pollsters argue that this doesn't matter for the types of polls they normally run (commercial/marketing surveys), and for elections and other votes where they have regular consistent reference points they can compute adjustment models. But it's an open secret in the polling community that any poll question that has a "pro-social" or "civic duty" component to the answers will get wildly disproportionate results to what the public actually thinks. And worse, such questions tend not to have any obvious reference points to which the results can be re-calibrated. The political scientist being interviewed in the article probably either doesn't know about these problems, or doesn't care, because he seems very willing to 'correct' politicians about what 'the public' really believes. But he has no real way to know that. He can only know what the sort of public that is willing to spend time talking to political scientists believes, and there's good reason to think they're not really representative. [1] https://dailysceptic.org/archive/do-online-opinion-polls-overestimate-public-support-for-covid-restrictions/ https://dailysceptic.org/archive/do-online-opinion-polls-ove... [2] https://www.pewresearch.org/politics/2012/05/15/assessing-the-representativeness-of-public-opinion-surveys/#fn-20041070-2 https://www.pewresearch.org/politics/2012/05/15/assessing-th...
- rayiner 4y agoThis is an interesting analysis thank you.
- smt88 4y ago> Are opinion polls actually representative of what public opinion is Yes. > and more importantly, how the public will vote? No. And you touched on the key problem. It's impossible to poll how people will vote because voting differs in key ways: - tribal (party affiliation) component - secret - different wording - more fear of consequences (meaning that fear of "something going wrong" affects a vote but not a survey) - lots of other things I haven't personally researched So the key is for elected officials to figure out how to market a policy/candidate so it connects to the issue polled, and few of them are good at that.
- whimsicalism 4y agoThe first two do not seem different for polling vs. voting in a referenda.
- smt88 4y agoThat's not really true because referenda usually become partisan. One of the parties is often the one initiating it and choosing the verbiage, which means it's often presented extremely misleadingly, too.
- zosima 4y agoThere is also an art of making opinion polls say what you want them to say, e.g. by asking a biased question, sampling a demographic known to skew a certain way or using a method that largely may exclude certain demographics. (E.g. internet polling) On top of that, there will be selection bias in what polls are published. If the poll you've paid for does not support your narrative, there is no reason to publish it. Polls are therefore often skewed one way or another, and should probably only rarely be used as support for what the general population wants. At least when the margins are small. Especially if paid for by an organization with stakes in the question.
- ryandrake 4y agoDon't forget: - voter suppression[1] It doesn't really matter what percentage of the public favors X, when people who might vote for X are systematically blocked, coerced, or dissuaded from voting. And when one party tends to benefit from low voter turn-out, as is the case in the USA, it should be no surprise when very popular politicians or proposals that poll well, fail due to voter suppression. 1: https://www.votingrightsalliance.org/forms-of-voter-suppression https://www.votingrightsalliance.org/forms-of-voter-suppress...
- xirdstl 4y agoAn explanation I've heard is while people might support an issue, as shown in polling, they don't feel very strongly about it compared to other issues. In that sense, many (most?) opinion polls are not predictive of voting in any significant sense.
- whimsicalism 4y agoI don't see why this would cause people to vote differently from their beliefs on a referendum on the exact issue. This seems like a generic reason why people might vote for politicians who support things differently than how they are polled, but not responsive to what I am saying.
- 988747 4y agoI think the explanation here is that referendum is anonymous, while polls not so much. When questioned by the person doing the poll people tend to give answers that they think are expected from them (i.e. Politically Correct), at referendum they are free to vote according to their actual beliefs.
- xirdstl 4y agoYou're right, I misinterpreted what you were saying, and the explanation I described does not address that.
- yorwba 4y agoIf you have an opinion on an issue but don't care strongly about it, you might be willing to answer when polled, but unwilling to actively participate in a referendum.
- vegetablepotpie 4y agoWe’re assuming that public opinion influences policy. The opinions of the top 10% of income earners correlates highly with the direction of US policy whereas the bottom 90% have very small influence. https://www.cambridge.org/core/journals/perspectives-on-politics/article/testing-theories-of-american-politics-elites-interest-groups-and-average-citizens/62327F513959D0A304D4893B382B992B https://www.cambridge.org/core/journals/perspectives-on-poli...
- whimsicalism 4y agoYes, yes, yes the Princeton study. But I don't think I made any such assumption.
- esoterica 4y agoAnd yet the engineers and other PMCs who are definitely in the top 10% by income still conceive of themselves as part of an oppressed underclass with no influence on policy direction.
- kevinventullo 4y agoPerhaps it would be more accurate to say those who are in the top 10% by income/wealth in their state of residence.
- zzo38computer 4y agoMaybe there is also possibility that the restrictions in the referenda are not the ones that they intended. At least this is my experience of many policies.
- DuskStar 4y agoA lot of gun restrictions can be very different as presented versus how they are in practice. Especially when it comes to the sort of "edge cases" that don't actually end up being edge cases. Universal background checks sound like common sense to a lot of people, until it's pointed out that they mean that they suicidal person can't give their guns to a friend for safekeeping - or let a buddy borrow a hunting rifle for the weekend. (It also means implementing a national gun registry to actually enforce anything, and registries have led to confiscation too many times for comfort) Ditto with red flag laws - everyone wants to let the police take the guns away from the next school shooter, but a lot of people are justifiably wary that the police will just take guns from "every black man", "everyone that criticizes the local police department" or even just "absolutely everyone". (Or that potential home invaders will do this to their victim before invading) All Cops Are Bastards, but we can trust them to not abuse new powers over guns? So when the actual wording of the policy that gets shorthanded as "red flag laws" or "universal background checks" makes it to a referendum, you can see some of that come into play.
- beachy 4y agoThe slippery slope/edge case arguments. These things seem to be so complex in America. They're not. Can you loan a rifle to a buddy for a hunting weekend? Yes, as long as your buddy has his gun licence. Otherwise a hard no, as there's no proof your buddy has a damn clue about gun safety. And of course you, a licenced gun owner, can supervise your buddy while he shoots if he doesn't have a licence. Same for teaching your kids to shoot safely. Can that hunting rifle be an AR-15? No. Military assault rifles are not needed for hunting. You can use a bolt action rifle, or even a low powered semi-auto, .22. If you have special requirements - like hunting feral hogs from a helicopter - then you can apply for a special class of licence that allows you to possess said weapons, and use them for said purpose. Are there red flag rules? Obviously! Why would you let a disturbed individual have a lethal weapon? Can people still have their guns? Yes! But they must be stored in a secure gun safe, and some weapons (e.g pistols/concealable weapons), due to the risks they present, must be treated separately. You certainly can't carry your gun on your shoulder into the supermarket. And so it goes. The solutions to America's gun problem are obvious - from the outside.
- gumby 4y ago> …Are opinion polls actually representative of what public opinion is - and more importantly, how the public will vote? > It seems that on a lot of hot button issues … opinion polls show considerable support for [positions] that simply do not manifest when there are actual referenda on the issue… What an excellent question. There are a couple of issues. One is what is measured by public opinion surveys. Let’s say I ask “should roe be overturned?” Two people who think that roe is fine but the threshold should be moved might respond differently (“no — we just need to move the threshold” “yes — and replace it with the same but a different threshold”). The survey people know this but it’s very hard. Second, is that the voting options are never clear cut. A simple referendum can include the problem above; when voting for a candidate you may not find one with the same attitude as you on your most important question, or you may survey with the majority on three topics but find a minority position more important to you.
- chrismcb 4y agoI think one issue with many polls is the polls themselves are biased. Because of that it is easy for someone to dismiss results they don't like.