9 ms·
Foxy Nate Silver and why old-media hedgehogs could soon be old news
- guscost 14y agoI don't get the effort to lionize (foxitize?) Nate Silver just before this election. The "other side" says: http://dailycaller.com/2012/11/01/is-nate-silvers-value-at-risk/ http://dailycaller.com/2012/11/01/is-nate-silvers-value-at-r... "In 2008, the RealClearPolitics polling average was incorrect in two states — Indiana and North Carolina. Silver botched Indiana but correctly called North Carolina. In 2010, it was much worse. State polling averages were wrong in Alaska (they said Joe Miller would be elected), wrong in Colorado (they said Ken Buck would be elected), and embarrassingly wrong in Nevada (they said Harry Reid would be involuntarily retired). FiveThirtyEight incorrectly forecast the winner in each of those states, perfectly reflecting the inaccurate information contained in the state polls. Thus, of the five major state races in which polls were wrong over the last four years, Silver only got one right." Why don't people wait and see what happens?
- kmfrk 14y agoThe certainty of Romney's loss is bad for page views and viewer numbers for one. Pundits seem to have an interest in perpetuating uncertainty and turning the election into a narrative of a dead-heat horse race.
- cafard 14y agoWell, it worked that way in the Republican primaries, didn't it? There was never much doubt that Romney would be the nominee, but quite a cast got turns at playing the non-Romney option of the week.
- btilly 14y agoDuh. Base a model on polling data and you are only as good as your polling data. If the election is swung by cheating this time (as evidence suggests has happened plenty of times in the past), polls will be spectacularly wrong. Incorporate everything else you can think of and you get only a bit more accurate. However the question is this. Do you have anything more accurate? I've had the experience on NPR of hearing pundits going on at length about what states matter. And it was less informative than a glance at http://www.electoral-vote.com/ http://www.electoral-vote.com/ is. So no, it is not perfect. Nobody, particularly Nate, says that it is. But we don't have anything better.
- jeffdavis 14y agoSo what does he add to the conversation? We can all see the electoral map. It's just a question of which polls you believe (or want to believe).
- mikeryan 14y agoThe five thirty eight model is actually based on accounting for accuracies in the polling data. It take's a poll's historical accuracy into account when weighing its impact on the model. This is where he gets an additional degree of accuracy as opposed to straight poll aggregation. So it actually does "choose" which polls to believe...
- mayneack 14y agoYes. Unbiased != more accurate. If, for example, there is a poll you KNOW is doing something wrong, you should down-weight it. A pure polling average there would be wrong. However, once you start weighting polls, people start criticizing the way you do it.
- jtfairbank 14y agoCheck out http://electionanalytics.cs.illinois.edu/ http://electionanalytics.cs.illinois.edu/ for an alternative to Nate Silver. It uses bayesian analysis and dynamic program to come up with a deterministic snapshot of the election. It is based on the polling data, so if the data is off the snapshot will be off, but otherwise it seems to provide a great snapshot of the Election.
- mkr-hn 14y agoI think that's the same method Nate Silver uses. edit: I just looked at your comment history. Repeating the same comment over and over is going to cause problems.
- schwabacher 14y agoThe Daily Caller analysis misses an important point - there is a much larger volume of polling data for presidential elections than for congressional elections. Drawing conclusion from one about the other is largely meaningless.
- ajross 14y agoPeople don't "wait and see" because they want to know now what the likelihood of the future is. That's hardly unique or surprising. This is an important subject. But I don't follow your evidence at all. The primary data output from 538 is a single number -- a chance of winning the election. How is that refuted by the inability to call every single state race? No one, certainly not Silver, claims to be able to do that. But numerate folks still understand that those probabilities can be combined to give a meaningful answer. So let's flip it around: why don't you believe the (currently) 83% figure? If your answer is because some of those states will come out differently than their median expectation, you're completely missing the point.
- dbecker 14y agoSports fans are constantly arguing about who they think is going to win such-and-such game. It's not important... but people enjoy it. This isn't much different. For both the games and the election, we will wait and see what actually happens. In the mean time, we enjoy discussing and forecasting.
- sxp 14y ago>“If you think it’s a toss-up, let’s bet,” Silver Tweeted at Scarborough. “If Obama wins, you donate $1,000 to the American Red Cross. If Romney wins, I do. Deal?” Wouldn't a better bet be something like $800 to Scarborough's charity if Romney wins or $200 to Silver's charity if Obama wins given that Silver has Obama at 80%? That makes Silver's confidence more visible than by using an even bet.
- ssharp 14y agoI'd rather get 1/1 on a bet bookmakers are laying 1/4 on than make my confidence more visible :)
- albedoa 14y agoExactly this. A fair bet is theoretically passing money back and forth. Silver should offer the worst odds that Scarborough is likely to accept, which should be 1:1 is Scarborough is as confident as he claims.
- MaysonL 14y agoScarborough's the one saying it's a toss-up, so Silver's proposing a bet at Joe's odds. If Joe really believes his own odds, the bet would be fair.
- btilly 14y agoAny competent gambler knows that a fair bet is not worth taking. See the Kelly criterion if you don't know what I am talking about.
- SkyMarshal 14y agoThat's also the point, Nate is implying Joe is not a competent gambler, or at least not a competent odds-calculator.
- malkia 14y agoI therefore propose Fox News to change it's name to Hedgehog News - "News straight from the guts!"
- mynameishere 14y agoNormally reporters are supposed to be unbiased, and so making a call one way or the other is inappropriate. In OP/ED mode, probabilities are completely beside the point. No one is going to say, "You should vote for XYZ because he is currently the most likely to win." I really am not sure what the point of predicting is unless you're betting, or unless you're a high-level campaign manager who needs to allocate resources in various districts/states.
- nmcfarl 14y agoI can give you another reason with a much bigger population base. You have a candidate you are backing, with your time and/or money. But you are not made of time and money. What are you doing this weekend, working in the yard, or at the phone-bank? Signing checks to your candidate, or putting that money back into your business? Predictions help a lot here - they're useful for time and money allocations other than just at the "high-level campaign manager" level.
- tspike 14y agoSounds like a self-fulfilling prophecy to me. I agree that disinterested parties have a lot to gain from a probabilistic analysis, but someone who's working at the phone bank likely cares deeply about the cause and is convinced that their efforts can make a difference. At a macro scale, they do make a difference. It's precisely those kinds of actions which shift the overall probabilities regarding the outcome.
- albedoa 14y agoCiting statistical models based on massive samples of polling data is not biased reporting; it's based on fact, on what's actually happening. What the the media should not be saying is that the race is close when it isn't. It has no basis in reality. One purpose of predicting the outcome is to take the narrative back from the pundits whose obvious motives are to maintain the perception of a close race. That's media bias. The FivetThirtyEight is a response to that.
- lmg643 14y agoi like to keep in mind that intrade had 80% odds on the supreme court ruling obamacare unconstitutional, right before it was declared constitutional: http://www.intrade.com/v4/markets/contract/?contractId=745353 http://www.intrade.com/v4/markets/contract/?contractId=74535... the idea that bookies and betting sites have something to teach us about real outcomes is a little rich. the optimal outcome for a sports book is to have heavy betting in the wrong direction.
- kristofferR 14y agoThey were right, there were probably an 80% chance that they would declare Obamacare unconstitutional. The thing with 20% chance to happen happened, like it does once in a while. If there's 80% chance of something happening, it doesn't mean that the 20% alternative won't happen or that you was wrong if it happened.
- btilly 14y agoIf you believe that bookies are consistently giving the odds wrong, then you should start consistently taking their money. Yes, I'm aware that this way of thinking is odd to people who do not understand markets, gambling, and so on. But it is still true. Bookies try really, really hard to give correct odds. And if you look at 20 bets which had 80% odds, you would expect to find several examples where the expected winner lost. That's why the odds were set at 80% and not 99%.
- lmg643 14y agoi am only inspired to mention this because nate silver mentioned oddsmakers as evidence supporting his prediction. https://twitter.com/fivethirtyeight/status/263948034105278464 https://twitter.com/fivethirtyeight/status/26394803410527846... i'm mixing examples here. intrade is a betting market, no line is set by a bookie - it measures public opinion. one way to look at it is that intrade is efficient and there was truly a "20% chance it will occur." the other way to look at it is "the odds were never 80/20" because most people betting on it were uninformed or misinformed (clearly watching WAY too much Fox news). this is unknowable, because it's not a repeatable event. prediction markets were originally based on the idea that folks with inside information would bet heavily and clearly justice roberts had other stuff to do. understanding how sports books work is not the same as saying "i know enough about sports to bet profitably." that said, bets set by a casino or sports book are different than intrade. a bookie is trying to maximize house profit, whereas intrade is pure sentiment. a sports spread can be -2 with 80% of people betting one side. the house might think the real spread is -4, and they expect the line to pay off. here's an example of how lopsided bets can be: http://www.thespread.com/ncaa-college-football-public-betting-chart#.UJWDjKg0V8E http://www.thespread.com/ncaa-college-football-public-bettin... I'm reading "sharp sports betting" by sanford wong right now. good quote: "I had the opportunity to ask Robert Walker, race and sportsbook director at MGM mirage, whether his company's action is balanced on football games...it appeared to me that sportsbooks might be taking lopsided action on about half of all NFL games. Mr Walker answered that what I hypothesized was indeed the case....then i asked him why he did not make more line moves to try and balance the action. his answer was that to move the line to try to balance the action would result in less profit for the sportsbook."
- jtfairbank 14y agoCheck out http://electionanalytics.cs.illinois.edu/ http://electionanalytics.cs.illinois.edu/ for an alternative to Nate Silver. It uses bayesian analysis and dynamic program to come up with a deterministic snapshot of the election.
- dietrichepp 14y agoThe hilarious part of this article is how it's so clearly a "hedgehog" article. > Hedgehogs are “type A personalities who believe in Big Ideas – in governing principles about the world ... Hedgehogs are more easily seduced by clear narratives. Foxes are more data-driven, less willing to stake out strong positions. Wouldn't you say this article is definitely a "clear narrative" and a "strong position" that is not backed up by data, nor does this categorization of people seem to show "nuance, uncertainty, complexity, and dissenting opinion"? It's an article for hedgehogs.
- ChristianMarks 14y agoI welcome the demise of the non-mathematical political pundit.
- qeorge 14y agoSaying Nate Silver is "wrong" is like saying the weatherman is wrong. Neither is taking a position, just reporting an aggregated statistic.
- waterlesscloud 14y agoThat's true of his model, but in his writing he's definitely taken a position.
- albedoa 14y agoIn what way? How has he taken more of a position on the election outcome than a weather forecaster does on weather outcome?