7 ms·
A few words about FiveThirtyEight
- henning 2y ago[flagged]
- decimalenough 2y ago538's final forecast was Kamala 50%, Trump 49%. https://projects.fivethirtyeight.com/2024-election-forecast/ https://projects.fivethirtyeight.com/2024-election-forecast/
- snickerbockers 2y agoNobody who thinks they can pin a probability on an event that only gets sampled once should ever be taken seriously.
- bcoates 2y agoAnd yet, the silver report final modal outcome was exactly the actual result.
- iuyhtgbd 2y agoThis is such tired debate that comes up whenever 538 is mentioned in discussion. Polls sample an election's outcome many times throughout the campaign. Statistics works. You can't know the future but you can predict it with error bars. 51/49 or 70/30 should tell you there's a very real chance of a Trump victory. People get bent out of shape about 538 but it's usually because they're misinterpreting the prediction, not that the prediction is meaningless.
- deleted 2y ago[deleted]
- snickerbockers 2y ago>Statistics works it does but just because nate silver calls something "statistics" doesn't necessarily mean that it is. If Donald Trump has a 20% chance of winning that means that we can hold the election 100 times and expect that he'll win approximately 20 elections and lose the other 80. Which is ridiculous because each voter is not an independent random variable.
- iuyhtgbd 2y agoEach eligible voter is a random variable, independence aside. Silver's model does not operate on the level of the voter however. A random variable is a very flexible abstraction, almost anything can be a random variable if you can find a way to measure it. Polls are a measurement. They're imperfect, but all measurements contain error. It's not statistics because any authority says it is, it's statistics because it starts with a measure of probability (aggregated polls) and builds an interpretation on top of it. That's what statistics is. It can be good statistics or bad statistics, but that's a separate question. Incidentally, it has a pretty good track record. If you have a criticism of Silver's model I'm curious to hear it. However, as it is I don't see a criticism in your comment. You say it's ridiculous, but it isn't. It's complicated, not ridiculous. I can't say precisely what's on your mind, but if I had to guess, it doesn't make sense to you, which is a different matter.
- snickerbockers 2y agoI don't see the point in anything that isn't falsifiable, and in order for that to happen there needs to be a sample size greater than one. If Hillary has a 99.9% chance of winning and Donald has a 0.1% chance of winning, does that mean the model was wrong or does that mean we're in the 0.1% timeline? If you want to prove that a coin flip has a 50% chance of landing heads, a 50% chance of landing on tails, and a negligible chance of landing on its edge, you can run as many tests as you want and observe that as N approaches infinity the number of heads converges on 0.5N and the number of tails converges on 0.5N. Alternatively, you might find that the coin isn't well-balanced, in which case you've proven that the "50/50 model" was not accurate. You can't do that with elections because each election only happens once. Even if the same two candidates are running against each other in every election, the issues at stake are different and the voterbase is different. In reality one candidate has a 100% chance of victory and the other has a 0% chance of victory but we don't know which candidate it is.
- NeutralCrane 2y agoEach race is only sampled once. But he runs the same methodology on hundreds of races. If the candidates he gives an X% chance to win go on to win approximately X% of the time, the methodology is reliable.
- magicalist 2y agoNot if the methodology is different per race, which it is. No other office is elected like the president is.
- Enginerrrd 2y agoHave you ever heard of a brier score? Or bayes theorem, and bayseian inference? You might change your mind if you investigate those topics.
- MrMcCall 2y ago"There's lies, damned lies, and statistics." --Unknown
- koolba 2y agoYou mean polls like this that put Clinton 15% ahead? https://www.jsonline.com/story/news/blogs/wisconsin-voter/2016/08/10/clinton-leads-trump-by-15-among-likely-voters/88541702/ https://www.jsonline.com/story/news/blogs/wisconsin-voter/20... I think there’s a stronger argument that those polls were intended to suppress Trump voters into thinking they were not the majority (when in fact they were).
- FireBeyond 2y agoI think there's also a huge misunderstanding of statistics in the US. More than one person I've spoken to believed that when sites said things like "Hilary has a 70% chance of winning" that that was the same as getting 70% of the vote, i.e. a landslide. I've had literal arguments with people who can't/won't understand the difference between an average and a median even when presented with 5th grade level phrasing examples.
- enjo 2y ago>I think there’s a stronger argument that those polls were intended to suppress Trump voters into thinking they were not the majority (when in fact they were). Show your work. What evidence do you have to support that argument?
- Gerardo1 2y agoAre you saying that Trump won the popular vote in 2016?
- koolba 2y agoHe won the popular vote in 2016 in States like Wisconsin that for months said he was 10-15% behind in the polls. It’s my interpretation that those polls were wrong but the majority of the media didn’t care. They just wanted to push a narrative that supporting Trump was a fringe minority in those States, rather than the true majority that it was.
- pitpatagain 2y agoThis is not an accurate description of the magnitude of polling error in 2016 in WI, which was the state with the most significant polling error that year by a very large margin, see Table 2 "2016 final polling average versus actual results": https://centerforpolitics.org/crystalball/polling-error-in-2016-2020-look-out-for-wisconsin/ https://centerforpolitics.org/crystalball/polling-error-in-2... The final difference from polling in WI was 7%, other states had smaller polling errors. The fact is that 2016 was simply an extremely tight race in many states and difficult to forecast even with completely normal polling error bars.
- bcoates 2y agoInnumerates keep self identifying, even 8+ years later. Please learn anything the Fremdschämen is getting painful.
- MrMcCall 2y ago[flagged]
- iuyhtgbd 2y agoWhat does that mean?
- MrMcCall 2y ago[flagged]
- jordemort 2y agoI'm guessing the first word is either "get" or "eat"
- iuyhtgbd 2y agoI don't know if I'm just dense but I continue to have no idea what the implication is.
- SkyMarshal 2y agoYou're not alone. Can't be that important though.
- adpirz 2y agoboth "get" and "eat" would be followed by an expletive. op doesn't like nate.
- iuyhtgbd 2y agoFor sure. Thanks for explaining, I think you're right. Whenever I hear him interviewed (or read his books) I come away with the impression Silverman is a bit up his own rear but I don't see what's objectionable about writing recommendations for people you've worked with. That's pretty normal.
- moffers 2y agoI really enjoyed 538 in its heyday, and am glad to see Nate carry on with some of the work. I know he can be a polarizing in some circles, but keeping the data angle visible helps smooth some of the rougher edges of following politics sometimes.
- mmahemoff 2y agoI learned more from the reaction to Nate and 538’s forecasts than 538 itself. It helped me appreciate how journalists misunderstand and distort basic probability. If a model predicts A, B, and C as having 34%, 33%, and 33% likelihood respectively, the typical report is “538 predicts ‘A’ will win!” and they got it totally wrong when B or C is the victor. Interpretations of 538 were further fuelled by whatever political bias a pundit was coming from. In a world where Kevin Rose can reboot Digg, Nate has every chance of acquiring and reviving 538. Good luck to Nate.
- rconti 2y agoI really enjoy Nate's podcast with Maria Konnikova - I read her book The Biggest Bluff a few years back and really enjoyed it, and them podcasting together is great. (Despite my feelings about never wanting to hear Malcolm Gladwell's voice ever again, as he's omnipresent in Pushkin podcast network ads, which seem to be the worst of the entire podcasting ecosystem). I never really followed the "Nate Silver" controversy after 2016, but it basically seems to boil down to a bunch of liberals being mad because they felt lied to for no apparent reason.
- nozzlegear 2y ago> I never really followed the "Nate Silver" controversy after 2016, but it basically seems to boil down to a bunch of liberals being mad because they felt lied to for no apparent reason. FWIW I don't think he's controversial because of the 2016 polling miss, most people who follow 538 understand what 538 does and that it wasn't his "fault." He's controversial because he posts scalding hot takes on Twitter and then goes to the mat to defend them. He also has a penchant for getting into Twitter beefs with other big names in his industry.
- qqtt 2y agoAs someone who was super interested in the 538-style of election coverage in 2008, I've kind of fallen "out of love" so to speak with election models and forecasting in general. I'm not really convinced about what it adds to the conversation around elections. We can all look at various polls and get an assessment of who is generally ahead. Weighted polling aggregators and forecasting models just collect all these polls and spit out some data. It's easy to hand wave and think some new information is being revealed, but ultimately it is just a "garbage in garbage out" situation - you are entering polls as input, some hand waving is going on, and you get some forecast as a result. I think part of my cynicism comes in the wake of the 2016 election, in which the forecast rightfully counted some scenarios in which either candidate could win, upon which conclusion of the model was basically "the result fits in with the forecast, because either candidate could have won according to the model" - in which case I personally concluded, if no matter what the result, we can always just say "the candidate who won could always have won given the forecast" - what are we really adding to the conversation here? We can simply look at polls and understand who is generally ahead, and not be any better or worse off.
- fitsumbelay 2y agoagreed on all points
- smt88 2y agoThe purpose of statistical coverage of elections is to tell campaigns what their strengths and weaknesses are and to entertain the rest of us. Since we don't run campaigns, the only value is entertainment. But that's not a negligible value for a lot of people.
- ks2048 2y agoI agree it's mainly entertainment, but it also affects a lot of people "involved" in campaigns who aren't "running" them - mainly people donating their money or time.
- sdwr 2y agoI kinda get your point - statistics suck the air out of the room. If regular people are talking about swing state poll margins of error instead of the actual issues, something's gone wrong. 538 democrasized the numbers that were the domain of political whizzes. I don't know if that's a good thing.
- chasing 2y agoI already miss the approval charts over time. Where the best place to see those, now?
- relaxing 2y agoPew Research.
- dragonwriter 2y agoPew, Gallup, and other pollsters each have charts based on their own individual poll series; 538s were a wide ranging aggregate of pretty much all the public polls which reduced the impact of noise.
- bbatha 2y agoIn this article Nate said his version would be up in a week or so.
- byproxy 2y agoYou might find https://www.realclearpolling.com/ https://www.realclearpolling.com/ useful.
- WiSaGaN 2y agoGlad to hear they will revive the NBA part. Was using the model extensively. It was very informative.
- laweijfmvo 2y agoit must be a wild experience to have a megacorp buy out your brain child, burn it to ashes and throw it away, and chase after the next shiny thing to slap ads on...
- prawn 2y agoNate: "I wasn’t technically laid off — but my existing contract was set to expire in June 2023, and there was profound mutual disinterest in negotiating a new deal."
- Hamuko 2y agoSeems like just the natural samsara of the news world. Small outlets are acquired by larger ones, eventually dismantled, staff moving onto build new ones and starting the cycle anew.
- kelnos 2y agoThe interesting thing about his experience, though, is that he had the clout (and foresight?) to craft the deal so that he was merely licensing his models to Disney, and ever since he left, Disney has not been able to use them (well, for some of the sports-related ones, Disney was permitted to keep a copy, but not benefit from further work on it). So Silver still seems to have the rights to the important stuff that made FiveThirtyEight what it was. He can (and has been) more or less building a new version of it, using all his old IP as a base.
- TheRealDunkirk 2y ago<Microsoft clears its throat and glances around nervously...>
- red_hare 2y agoI started listening to the 538 Politics podcast a lifetime ago when they did The Gerrymandering Project. The deep intertwining of history, intentions, and statistics made the narrative compelling. I learned so much about how our democracy worked that I would never have known otherwise. So, I kept listening and kept learning. It was sometimes difficult, not because of their storytelling skills, but because the news was hard to consume. But the cold numbers helped me manage my emotions with clarity and not disengage. There's something wonderful about journalism backed by data. The line between news and editorial has long been blurred beyond visibility. 538 was a rare example of a place where smart people could express strong opinions but always had to show the work behind their conclusions. I'll miss 538. They were an amazing team.
- alisonatwork 2y agoI will miss them too. I saw that Galen is already considering starting his own politics pod, but I fear that by immediately jumping into the Substack black hole it will just end up spiraling into the usual engagement-driven slide to the right: https://www.gdpolitics.com/p/my-thoughts-on-the-end-of-fivethirtyeight https://www.gdpolitics.com/p/my-thoughts-on-the-end-of-fivet... Imo part of what made 538 work post-blogosphere heyday was exactly that it had backing from legacy media and the funding to continue sharing information with the public without a paywall. As soon as sites go behind a paywall they become a personification of the "media elite" stereotype, where only rich people have the privilege of being informed. But how otherwise to fund not just a cheerful host but a team of data scientists, editors etc in this day and age? Seems like the only interested billionaires do it with strings attached.
- kemayo 2y agoYeah, they've been on my podcast subscription list for at least 5 years now, and I'll miss having them around. I had growing conflicted feelings about the site's overall impact on media, sadly. It felt like, although it was good that they existed as a dedicated organization, they contributed to (or were a symptom of) the overall media landscape's slide into politics coverage as mostly coverage of the horse-race. Sometimes I want to hear what the Scottish teens think a news story means... but more often I want something deeply reported about policy.
- tekla 2y agoThis is an absolute loss. 538 is amazing because it forced people to confront the cold hard data about polls surrounding politics and if you didn't like it, figure out what they did wrong or deal with it. I'll never forget being called racist because I showed someone a 538 poll that said the presidential election was at best a toss-up to someone who was sure Kamala Harris would sweep the swing states.
- kelnos 2y ago538 hasn't really been 538 since Silver left, as Disney lost the rights to Silver's models (he maintained ownership of them) at that point. I'm honestly not too sad over the ABC News version of 538 folding; Silver's own continuing work will fill the niche that the old-school 538 flled.
- nomilk 2y ago> Last night, as President Trump delivered his State of the Union address, the Wall Street Journal reported that ABC News would lay off the remaining staff at 538 as part of broader cuts within corporate parent Disney. Did Trump's policies cause the layoffs, or does Nate just happen to mention Trump's address? (forgive my ignorance - feels odd to mention the address if it had nothing to do with the layoffs, but I'm not aware of any obvious connection)
- stackskipton 2y agoNo, I think Nate was pointing out while everyone was distracted by Trump State of the Union, 538 was cut so few people would notice.
- doctorpangloss 2y agoNate, no. FiveThirtyEight is being shut down because its election model is wrong.
- deleted 2y ago[deleted]
- BrenBarn 2y agoFiveThirtyEight was interesting in its time, but in the past few years I felt it ironically became exactly what it was initially trying to oppose: a site full of opinion-based punditry. All their "538 chats" were basically the same as talking heads on TV. Okay, the 538 talking heads maybe paid more attention to data, but the good part of 538 was the intent to cut to the chase, dispense with all the puffery that ordinary news sources shove at you, and just let the data speak for itself. In recent years they moved away from that and became less distinguishable from the opinion section of a mainstream news source.
- vintermann 2y ago> almost never interfered in our editorial process Almost. This means that they were perfectly willing to, but rarely had to. If it were otherwise, as Chomsky said, "You wouldn't be sitting where you're sitting".
- fsckboy 2y ago>538-style of election coverage in 2008... I'm not really convinced about what it adds to the conversation around elections I'm not really convinced that conversations around elections add anything. <-- period. for me, 538-style coverage is great substitute for having to listen to myriad opinions that are generally facially flawed, and neither a representative sample.
- amai 2y agoNobody needs election predictions in a dictatorship.