6 ms·
How did NPR’s pre-election poll get things so so so wrong?
- PaulHoule 4y agoNot sure what "there" there is here. Republicans did not overwhelm but it looks like they will get control of the house. The senate is hanging by a thread. Since Reagan there have always been Democratic senators that vote with the Republicans. Between that and the filibuster, the Democrats would need to control something like 65 seats in the Senate to really say they control the Senate. We'll be in the divided government state which is normal for American politics. As for "friends and family" I expected my wife to vote Democratic and my son to vote Republican, probably my coworkers to vote Democratic and many of my friends but one long-term friend of mine is the ringleader of the local Republican party. So my answer to that question would be "mu".
- zdragnar 4y agoThere was a lot of hype around a "red wave", not only in the senate but towards election day several governorships where the Democratic governor had a lead completely vanish. I suspect much of this boils down to pollsters consistently undercounting republican support for several election cycles and over-correcting this time around.
- 0x500x79 4y agoI think that is the point: Polling/Outlets had them getting a massive lead, keep in mind too that this was the worst performance for midterms for the party that does not hold the presidency in a very long time. Usually the party that has the presidency takes a larger share of the house in midterms. The fact that the polling was calling for a "Red Wave" and that the "Red Wave" severely underperformed is the thing that is being investigated now.
- PaulHoule 4y ago538 has been all through this. 538 expected the Senate to be close and for Republicans to win the house, which seems to be the outcome. https://fivethirtyeight.com/features/our-best-tool-for-predicting-midterm-elections-doesnt-show-a-republican-wave-but-history-is-on-the-gops-side/ https://fivethirtyeight.com/features/our-best-tool-for-predi... It's normal for the president's party to lose some ground in the midterms. Biden's approval numbers were poor which was not good for the dems... but, that's countered by Trumpism being unpopular. Republicans who were sane did pretty well, lunatics like Oz didn't. Trumpism was so toxic that it was a winning strategy for Democrats to promote the worst Republicans in their primaries.
- 0x500x79 4y agoIt was the outcome... on a much, much smaller margin that usually happens around this time in the cycle.
- chomp 4y ago> One possibility is that Republican family/friends/coworkers were more public about their political views, compared to Democratic family/friends/coworkers. I live in the South. You learn very quickly as a Democrat to keep your mouth closed about politics. I know everyone in my life who votes R consistently, but the D's are harder to pin down. Election polling is even harder than weather forecasting these days. At least cold fronts follow general patterns.
- Overtonwindow 4y agoWhen I lived in Redwood City, CA I learned to keep my mouth shut that I was a conservative. If it had gotten out then my job would’ve been under threat, and maybe my own personal safety.
- taolegal 4y agowonder why this is getting downvoted, cause I know people would think differently about me if I said I was conservative, they're all about diversity until you don't agree with them
- tjs8rj 4y agoEveryone said the reverse of this when the polling failed in 2016 - that Republicans were afraid to share their political affiliation for fear of being cancelled etc
- theprincess 4y agoIt's pretty simple. In Democratic areas you don't speak out about being Republican and in Republican areas you don't speak out about being a Democrat. I'm from the South, lived in Oregon and New York for a while, and now live in the South again so I've seen the dynamics play both ways. Social ostracism is more vicious from Democrats but I've known of Republicans to spread outrageous rumors about Democratic voters and in places like where I grew up, if you're a man, you'll be called gay/pedo and possibly beaten (usually not jumped, but aggressively taunted with slurs until a fight ensues from what I've seen IRL) unless you're well liked for some other reason like that you're well connected, have money, or are really masculine/served in the military. Overall I'd say it's better to be a Republican in a Democratic area than the opposite since the looming threat of physical violence is worse than people just thinking you're a bad person. The main reason why Republicans in Democratic areas would have to worry would be if they work in a creative industry where being known as a bigot of some kind would cause people to not like to collaborate with you but even then you're relatively safe as long is you're only bigoted against one of the less protected minority groups like trans people (probably why trans people are the culture war topic du jour).
- chedca21 4y ago
- marviel 4y agoWhat do you mean by this?
- chedca21 4y agoMachines not functioning? Same scrambled voter rolls? "Sorry it says you already votes absentee"? Where oversight of elections was too thorough it got changed to election month - Florida can count millions of ballots on election day but other states need more time? Truly one has to bury their head in the sand if they are to stand by election integrity in 2022
- helloSirMan 4y agoAt this point I'm not sure how good polling can be carried out, in terms of data collection methods: Phone behavior is generationally defined, I'm not sure if the average gen Z'er talks via the phone function of...a phone. It would be much more reasonable to expect an app based communication. Ask the captain of the SS Boaty McBoatface about polling via internet. It's all polls in an echo chamber and big targets for those that would wish to introduce bias.
- rob74 4y agoBoaty McBoatface doesn't have a captain, it's a robotic autonomous underwater vehicle (https://en.wikipedia.org/wiki/Boaty_McBoatface https://en.wikipedia.org/wiki/Boaty_McBoatface), one of three carried by the RSS Sir David Attenborough, that was initially supposed to get that name, but then... didn't.
- chedca21 4y ago
- amir734jj 4y agoI would say they underestimated the impact of federal abortion ban had on women. I live in Wisconsin and seen it first hand. Women who are struggling financially wanting to vote Republican but they don't and they vote democrat because they have young girls at home and worried about their future and having options. It was a mistake on Republicans part to ban abortion at the federal level. Personally, I'm against abortion and I find it immoral but I also think government shouldn't interfere with women's healthcare.
- copenseethe 4y ago
- Mdndndns 4y agoRepublicans never banned abortion at the federal level.
- pc86 4y agoAbortion is not banned at the federal level.
- amir734jj 4y agoYou are playing with semantics. Please look into Dobbs decision. Source: https://en.m.wikipedia.org/wiki/Dobbs_v._Jackson_Women%27s_Health_Organization#:~:text=The%20majority%20held%20that%20abortion,to%20regulate%20access%20to%20abortion https://en.m.wikipedia.org/wiki/Dobbs_v._Jackson_Women%27s_H....
- devwastaken 4y ago"individual states have the authority to regulate access to abortion" Not the same thing.
- gfdsgfsdg 4y agoYou are wrong. Being not a constitutional right doesn't mean it's banned.
- shagie 4y agoThey didn't get it wrong - they were trying to understand if it was a better (or useful) model by carrying out an experiment by adding it to the other polling questions. It turned out that the model developed from that question was a worse predictor, but that isn't wrong any more than carrying out an experiment that didn't match the expected results is wrong. That they are coming back and looking at it again is good. Note also that the people who are asking these questions (good questions, just asked wrong) come from an economic rather than polling background and getting the right wording for a question is very hard.
- mcphage 4y ago> It turned out that the model developed from that question was a worse predictor, but that isn't wrong any more than carrying out an experiment that didn't match the expected results is wrong. I don't know if that's entirely true. From the article: > Oddly enough, NPR just reported these numbers with a straight face, without saying anything about how off they seemed to be. Which is to say, they performed an experiment. That experiment failed—which, as you say, is a totally acceptable outcome of an experiment. But when reporting their results, they don't seem to have indicated that (a) what they were reporting on was an experiment, or that (b) the results didn't seem promising, or in line with expectations. Instead, the article implied that they reported the results as if they were meaningful predictions.
- shagie 4y agoGive the transcript a read - https://www.npr.org/transcripts/1134434712 https://www.npr.org/transcripts/1134434712 --- FOUNTAIN: ... So, Barbara, we have a question for you. CARVALHO: Uh-oh. FOUNTAIN: Would you be willing to let us test one of these methods in one of your polls? CARVALHO: Oh, sure. FOUNTAIN: Really? CARVALHO: Well, if they're - I mean, if they're appropriate, objective, you know, questions, that would be great. GUO: So here's the exciting news. We worked with Barbara to draft two questions - one, where we ask people to predict the election and another asking them who the folks in their social circles are voting for. FOUNTAIN: She said she would slip them into a poll Marist is doing before the midterms, run some analyses and let us know how useful they might be for the future of polling. ... CARVALHO: When we look at who people think that their social contacts are going to vote for, we actually found among registered voters a plus-10 Republican... GUO: That's a big difference. CARVALHO: ...And a plus-14 among those who say that they're definitely going to vote. When we look at who they think is most likely to win the election in their district, we see among registered voters a plus-12 Republican. FOUNTAIN: Wow. CARVALHO: ...And a definite vote of a plus-16. FOUNTAIN: The wisdom-of-the-crowds type questions are heavily favoring the Republicans, much more than the standard question, though Barbara is careful to mention that all of this is just preliminary, and the real test is when she puts all this data together and does some analysis. And besides, it's a little hard to figure out which questions are working better on a national poll. But... GUO: If the election goes more toward the Republicans, is that a little bit more evidence for maybe the usefulness of these questions? CARVALHO: Absolutely. And so what we will take a look at - and mind you, we're not ending the experiment here.
- treis 4y agoThis just seems to be a mismatch of expectations. The Republicans won the election in that they are going to have more seats than they did before. People are saying they "lost" because they didn't win as much as people expected. To use a sports analogy, they won the game but didn't cover the spread.
- zaphod12 4y agoYes absolutely. In 2010 - Obama's first midterm - republicans gained like 64 seats in the house. It was a massacre for anything with a D next to their name on the ballot, expect in the most solidly blue locales. This was not like that at all. More of a regression to the mean in most places.
- tablespoon 4y ago> This just seems to be a mismatch of expectations. The Republicans won the election in that they are going to have more seats than they did before. People are saying they "lost" because they didn't win as much as people expected. To use a sports analogy, they won the game but didn't cover the spread. They under-performed very, very badly. It's like eking out a narrow win because (somehow) the sun was always in your opponents eyes and the wind was always at your back. Sure you got a win, but a win of that magnitude means you suck and will probably lose badly in the future.
- cudgy 4y agoThey might still get control of the Senate and the House, which is like winning the Super Bowl with a last minute field goal. They’ll take it if it happens and the teams (political talking points) will all be different in 2 years anyway.
- jeff-davis 4y agoIs accurate polling a good thing? It's not clear to me that democracy is helped by knowing what everyone else thinks.
- cudgy 4y agoIt does not help. It basically serves several purposes: 1) forms a talking point for political speculators in media to get views and clicks 2) used by political strategists to figure out what lies they can tell voters 3) used by political pundits to scare voters into action and lull voters into inaction. “Oh no! The Republican/Democratic red/blue wave is coming!” This discourages voters of the perceived victorious party from voting and encourages voters from the perceived losing party to vote.
- awinder 4y ago“nobody — nobody — was predicting that the Republicans would win by 12 or 16 percentage points.” An excess 14% thinking republicans will win doesn’t predict a 14% margin, it predicts 14% excess probability that republicans win, by some amount. Even that I’d be skeptical over though. I think this question is basically measuring which media narrative has become predominant & by how much.