3 ms·
AFAICT the polls had a systemic error AND the 538 models included the possibility of a systemic error. It's really the only way that they could have given Tru
by bryanlarsen 6y ago
AFAICT the polls had a systemic error AND the 538 models included the possibility of a systemic error. It's really the only way that they could have given Trump a 28% chance in the first place.
Of course, the polls themselves also acknowledge the chance of a systemic error. They're reported similar to +/- 2% 19 times out of 20. They make no claim that the 19/20 of multiple polls are not correlated.
- rayiner 6y agoThe +/- in a given poll is measurement error derived from the sample size. They don’t account for systemic error.
- bryanlarsen 6y ago19/20 does, though.
- rayiner 6y agoWhat is 19/20?
- deleted 6y ago[deleted]
- bryanlarsen 6y agoPolls are reported with fine print similar to "+/- 2%, 19 times out of 20".
- function_seven 6y agoRight, but 538 did account for such an error in coming up with their ~75/25% outcome chances. Had polling errors just been random, the overall prediction would have been more like 95/5%. But their key insight is that polling errors are often correlated, and not just statistical sampling errors that can randomly offset in either direction.
- dragonwriter 6y ago> The +/- in a given poll is measurement error derived from the sample size. They don’t account for systemic error. Sure, but even the worst poll-based prediction outfit isn't just aggregating poll results and using the uncertainty based on sample size to determine the probabilities of different outcomes. Pretty much all of them are using some model derived from the past relationships of polls to election results, which will, to a greater or lesser extent, capture systemic polling error that is not unique to the current cycle in the model.
- dragonwriter 6y ago> AFAICT the polls had a systemic error AND the 538 models included the possibility of a systemic error. Well, 538 model took into account historical evidence that election differences from polling averages between states are strongly correlated rather than independent; arguably, that's an effect that exists in part because such deviations are in part due to systemic errors (though the particular systemic errors may differ from cycle to cycle) in the polling, rather than pure sampling error.