4 ms·
https://projects.fivethirtyeight.com/checking-our-work/ https://projects.fivethirtyeight.com/checking-our-work/ In my opinion 538 nailed it in both 2016 and 20
by bryanlarsen 6y ago
https://projects.fivethirtyeight.com/checking-our-work/ https://projects.fivethirtyeight.com/checking-our-work/
In my opinion 538 nailed it in both 2016 and 2020. In 2016 they said Trump needed a full standard polling error to win. In 2020 they said he would need more than a full standard polling error.
The polls were wrong, and 538 told us what would happen in that scenario.
- rayiner 6y agoRight. The problem is the polling.
- thu2111 6y agoI've read that US polls are much smaller than equivalent UK polls, like sample sizes 90% lower, sometimes just a few hundred people whereas political polls in the UK use more like a thousand or two. It seems like an odd discrepancy. But really. If the polls are so unreliable then at some point people like FiveThirtyEight or the Economist need to understand that and stop incorporating them into models (which may mean not attempting to forecast at all). Just pointing the finger of blame around only gets you so far.
- joaomacp 6y agoI also tend to agree with Peter Thiel's point on The Portal podcast: a significant number of Americans lie on polls because they're ashamed of voting for Donald Trump. My opinion: I think deep down these people feel they are rationally wrong for voting in a president that promised to, and now is actually attacking USA's democracy and freedom which used to be touted as America's strong point. They know they're acting on instinct, and people tend to hide their instincts in public.
- skinkestek 6y agoHave my upvote. > My opinion: I think deep down these people feel they are rationally wrong for voting in a president that promised to, and now is actually attacking USA's democracy and freedom which used to be touted as America's strong point. I think you underestimate peoples distrust of mainstream politicians. Many find Trumps suggestions abhorrent, but still support investigations. Think if this happened to "your" candidate: - There's no doubt that Twitter and Facebook has been uncritically spreading false rumors about Trump only to turn right around and supress the H.Biden leaks, even after it was clear at least some of the juicy mails was cryptographically verified. If Twitter had been posting a warning everytime someone pretended the "fine folks on both sides" hoax then they would have been in a better position now. Same if they had come up with the rule against hacked materials when Trumps tax papers supposedly leaked. - Ballot collections - Sweeping changes to election laws etc etc. I dislike Trump, but it is hard to not get some sympathy for someone who has managed to get a number of really fantastic peace deals, have finally started to improve lives of people in the midwest - without hurting the coasts - and yet is hounded by almost every mainstream media outlet.
- rweir 6y agofacebook and twitter have also been uncritically spreading false rumours from trump and only in the past couple of months have done anything to arrest the swirling hive of insanity/bad faith/malicious interference that is qanon.
- skinkestek 6y agoHave my upvote for that too.
- hiq 6y ago> - There's no doubt that Twitter and Facebook has been uncritically spreading false rumors about Trump only to turn right around and supress the H.Biden leaks, even after it was clear at least some of the juicy mails was cryptographically verified. If Twitter had been posting a warning everytime someone pretended the "fine folks on both sides" hoax then they would have been in a better position now. Same if they had come up with the rule against hacked materials when Trumps tax papers supposedly leaked. Do you have a link that refers to this cryptographic verification? Last time I saw this talked about on HN, the summary was that there really wasn't even an ounce of evidence, and that the people who supposedly had it were not sharing it for no good reason, so I'd be interested if there has actually been a proper verification of this. > have finally started to improve lives of people in the midwest - without hurting the coasts What do you mean, and what's the source for this? Again I'm not that informed about this topic, so I'm genuinely curious about a source. That's also the problems when half his tweets make the headlines: that skews the information towards what he says rather than what he does, and given the votes of this election I tend to think that (at least the perception of) the latter is better than the former.
- Izkata 6y ago> Do you have a link that refers to this cryptographic verification? Last time I saw this talked about on HN, the summary was that there really wasn't even an ounce of evidence, and that the people who supposedly had it were not sharing it for no good reason, so I'd be interested if there has actually been a proper verification of this. I don't know what GP is talking about here, but what I remember is at least one person mentioned in the emails confirmed to the FBI that they're real.
- mcphage 6y ago> a significant number of Americans lie on polls because they're ashamed of voting for Donald Trump That has been addressed before, and it had seemed unlikely—there are races where more "normal" Republicans on the ballot (for house or senate races) were polling worse than Trump. So it might be that they're ashamed to vote for Trump, but why would they be ashamed—let alone even more ashamed—to vote for a normal Republican?
- jonstewart 6y agoWould that Peter Thiel himself felt more shame.
- JeremyNT 6y ago> The polls were wrong, and 538 told us what would happen in that scenario. How do you define the mythical "standard polling error" though? They have historical data, but polling techniques are always shifting. Per the article: > Suppose we’d included wider uncertainty intervals so the outcome was, say, within the 50% predictive interval. Fine. If we’d given Biden a 75% chance of winning and then he wins by a narrow margin, the forecast would look just fine and I’d be happier with our model. But the polls would still have messed up, it’s just that we would’ve better included the possibility of messing up in our model. If presidential polls are consistently off by large margins, and 538 considers those margins to be unlikely every time, (which seems to be where we'll land this year as well as we did in 2016), then maybe it's not just the polls that are wrong, but the 538 assumptions about poll accuracy as well. 2016 on its own doesn't condemn the 538 methodology, but 2020 is starting to look like a trend. Yes, outlier events happen, but if they happen consistently... well, maybe your definition of "outlier" is incorrect. The sample size on presidential elections is small, and maybe there's just too much uncertainty for a model like 538's to end up being useful.
- mcphage 6y ago> 2016 on its own doesn't condemn the 538 methodology, but 2020 is starting to look like a trend. Yes, outlier events happen, but if they happen consistently... well, maybe your definition of "outlier" is incorrect. I get what you're saying, and I agree—but then, what is to be done? 538 doesn't do polls themselves, they just aggregate them. If the polls are incorrect, what do you replace them with? And how do you make that scientific?
- JeremyNT 6y ago> I get what you're saying, and I agree—but then, what is to be done? 538 doesn't do polls themselves, they just aggregate them. If the polls are incorrect, what do you replace them with? And how do you make that scientific? The most straightforward way to adjust these models, that Gelman mentions himself, is to just assume more uncertainty in the polls and assign wider uncertainty intervals to the models' final projections. It doesn't "fix" the polls but it acknowledges that they aren't as predictive as previously assumed. One of the comments suggests integrating betting market data in some way, which seems to make some intuitive sense based on how well they have performed relative to polls.