4 ms·
This is a pretty good idea! The 538 people have mentioned before that they've had trouble with people misunderstanding probability (many people, apparently, bel
by rsynnott 6y ago
This is a pretty good idea! The 538 people have mentioned before that they've had trouble with people misunderstanding probability (many people, apparently, believe that things which have a 20% chance of happening will never happen and those with an 80% chance will always happen). Their current solution to this problem appears to be some sort of cartoon fox, but I think this illustration works better.
- jedberg 6y agoI think the cartoon fox was just because they need a graphic. The real way they are combating people's inability to interpret percentages is by dropping them lower down, and replacing the top line prediction with the word "slightly favored" or "favored" or "strongly favored".
- rsynnott 6y agoWell, the cartoon fox also provides narration. But yeah, the rearrangement of the page and better infographics is probably the biggest change. I'd be kind of curious to see if they have any evidence that it actually helps. It seems like it... might? But it's always hard to tell with these things.
- jedberg 6y agoProbably the best way to figure it out is to analyze reddit/hn for comments like "538 says Biden will win!" vs "538 says Biden might win go vote"
- Wowfunhappy 6y agoThere is, as the statisticians would say, a confounding variable: we all lived through the 2016 election.
- takeda 6y agoThe crazy thing though is that statistics also contributed to the loss. There was a campaign to discredit Clinton so many Democrats weren't happy about her. Seeing statistics in her favor many Democrats decided to either stay home or vote 3rd party. This also give extra opportunity to tilt scales in 3 important states to win the entire election. Moral of the story is, one should never assume that their candidate winning in polls is an excuse to not vote.
- heleninboodler 6y agoThe cartoon fox is really infantilizing. I know probability is tricky and sometimes counterintuitive, and I appreciate being taught things, but don't treat me like I'm in kindergarten.
- wilg 6y agoI think this says a lot more about you than it does about the cartoon fox!
- currymj 6y agoi have to imagine it would piss Nate Silver off to experience 4 years of continual mockery for "getting the election completely wrong" when he in fact got it right. anyway, I agree the cartoon fox seemed very condescending and I wonder whether there wasn't some real frustration with the public behind it.
- dragonwriter 6y ago> The cartoon fox is really infantilizing. I know probability is tricky and sometimes counterintuitive, and I appreciate being taught things, but don't treat me like I'm in kindergarten. Have you considered that you are quite possibly both more educated and more intelligent than the people whose experience the cartoon fox is designed to improve. Sure, I don't need it, but I haven't even noticed it since the first time I went to the forecast page this cycle.
- Wowfunhappy 6y agoThe first non-news graphic on Five Thirty Eight is literally a bunch of balls, colored red and blue. Short of actually including this type of auto-playing animation (which is perhaps the solution, but has its own issues), I'm not sure what else they could do. People are bad at dealing with uncertainty. And also don't read.
- rsynnott 6y agoI feel like the plinko type animation might be better, as it makes it really, really clear that, yes, the improbable thing can happen.
- deleted 6y ago[deleted]
- dragonwriter 6y ago> The first non-news graphic on Five Thirty Eight is literally a bunch of balls, colored red and blue. No, it is literally a set of maps of different outcomes of simulations representing (in a reduced way, because there's only room for 22 maps, at least on desktop; I think they have fewer on mobile) the range and frequency of simulation results. The balls come after that.
- adrianmonk 6y ago> many people, apparently, believe that things which have a 20% chance of happening will never happen and those with an 80% chance will always happen It could be the counter-intuitive nature of probability, but I wonder if it might sometimes just be that, psychologically, people have trouble accepting the idea that nobody really knows. You look at a site like FiveThirtyEight, you know the site is run by an expert, and you know that multiple sources of data have been fed into number-crunching computers. You've seen other situations where this type of process nails it. You have a strong desire to know the answer, and that biases you toward believing that you do. The idea that something so important is unknown is unpleasant, so you reject it. About the difficult of grasping the basic concept, if you've ever seen the TV show Card Sharks (https://en.wikipedia.org/wiki/Card_Sharks https://en.wikipedia.org/wiki/Card_Sharks), a key part of the game is that contestants see a card which is face up, and they have to make bets based on whether the next card drawn is higher or lower. In that context, they have no trouble understanding that if the face-up card is a 5, the next card is probably higher (6, 7, 8, 9, 10, J, Q, K, A) but it could also be lower (2, 3, 4). Essentially, I think people can understand that unlikely things happen, but where they have difficulty is seeing/admitting that this is one of those situations.
- impendia 6y ago> if you've ever seen the TV show Card Sharks... I developed and taught an entire undergraduate math class on the mathematics of game shows. https://people.math.sc.edu/thornef/schc212/gameshows-428.pdf https://people.math.sc.edu/thornef/schc212/gameshows-428.pdf Much of the class I worked out probabilities like these, and compared what contestants "should" do to what they actually do. Watching reruns of Card Sharks, The Price Is Right, and others, I've found that most people have a surprisingly good intuitive sense of probability. Not always, but more often than not.
- js2 6y agoExcept for that damn Monty Hall problem!
- rsynnott 6y agoI'm not sure it's that simple, because even _after the fact_ people were talking about how 538 "said Clinton would win". They're doing so in this comments section, in fact. I also seem to remember seeing a study that people made better probability-based decisions if given probabilities phrased as fractions than percentages; I wonder if something similar is going on with the cards example.
- pjc50 6y agoApart from xcom players, to whom 90% of something working means almost certain disaster.
- rsynnott 6y agoSome games actually do use fake random number generators that behave more like people intuitively expect randomness to behave; if there’s supposedly a 5% chance of something happening it will NEVER happen twice in a row, and so on.
- colinmhayes 6y agoI'm not convinced people actually have trouble misunderstanding probability. I think it's more likely that some bad faith conservatives said "look at how stupid the liberal media is, they said Hillary couldn't lose" and people actually believed that without checking what 538 actually said.