8 ms·
The Time Everyone “Corrected” the World’s Smartest Woman (2015)
- ColinWright 8y agoIn presentations/workshops I now find vanilla-flavoured Monty Hall to be of no real value - nearly everyone says "SWITCH!!" without thinking. So I offer this variant. I have 10 cups, and under one is a prize. I get a victim - ahem - volunteer to select two, and place markers on them. I then say clearly that I will remove 6 of the other cups and, to retain the mystery, will not reveal the prize. There are now four cups, the prize is under one, and two of them are the volunteer's original choice. And now the offer: They may retain their original two, or they may surrender their two and select only one of the other, currently unselected two. So: * What would you do, and why? * What interesting further variant can you think of?
- OscarCunningham 8y agoI think I should still switch, and for the same reason as in the original problem. The fact that you chose not to remove those two cups makes it more likely that one of them contain the prize.
- ColinWright 8y agoNow try the variant in another comment ... 12 doors, I let you choose 3. I then open 4, leaving your selected 3, and 5 others. I let you keep your original choice, or give them all up to choose only one of the other five. Should you switch now?
- OscarCunningham 8y agoMy intuition would be that the evidence in favour of the 5, given by the fact you chose not to reveal them, doesn't come close to outweighing the 3-to-1 advantage granted by sticking. Let me check with the actual calculations. If I stick I have a 3/12 chance of winning. If I switch and I originally did pick the winning cup then I always lose, and if I didn't then I win with probability 1/5. So my overall probability of winning if I switch is 3/12×0 + 9/12×1/5. So sticking gets me 1/4 and switching gets me 3/20. Sticking is better, but by a smaller margin than I expected.
- aetherson 8y agoThere's a 20% chance that the volunteer was initially correct. In the 80% case, one of the two remaining cups has the price beneath it, so choosing one of the remaining cups gets you a 40% chance of payout instead of your initial 20%. Switching doubles your chance of payout. This should be straightforward to anyone who actually understands the Monty Hall problem.
- yifanl 8y agoA very educational variant I've heard is to up the number of doors from 3 to 10000. Now that Monty is closing off 9998 doors, it makes the leap of logic much less difficult. Clearly the one door he didn't close off is special.
- ColinWright 8y agoPersonally, I find that completely uninformative. Others find it helpful and I won't deny their experience, but I find that no more convincing that proper arguments about the 3 door version. My variant was not intended to assist explaining the original, it's a variant intended to make people think again. It often exposes non-understanding in those who will blindly and automatically say "Switch". Here's another variant. 12 doors, I let you choose 3. I then open 4, leaving your chosen 3 and 5 others. I let you keep your original choice, or give them up to choose only one of the others. Should you switch now?
- grigri9 8y agoNo, In that P(3/12) = 25% The remaining doors have 75% probability and choosing 1/5 only gives you 15% chance of winning.
- ColinWright 8y agoCorrect. Explaining that to muggles, though, is non-trivial.
- phaemon 8y agoAn interesting variation is "what if you toss a coin to decide whether to switch or not". I find it weird that that resets the odds back to 50:50
- DoctorOetker 8y agothats not weird at all: 1/2 * 1/3 + 1/2 * 2/3 = 1/6 + 2/6 = 3/6 = 1/2 Edit: Thanks for pointing out the typesetting issue!
- ColinWright 8y agoYou need spaces around the splats, otherwise they are taken as formatting. I assume you mean 1/2 * 1/3 + 1/2 * 2/3 = 1/6+2/6 = 3/6 = 1/2. You can also reformat that as: 1/2 * 1/3 + 1/2 * 2/3 = 1/6 + 2/6 = 3/6 = 1/2
- phaemon 8y agoThanks to the pair of you for explaining something I pointed out to you in the first place. :) I said it was weird, not that I didn't understand it. I suspect this thought process is why numerate people get thrown by this puzzle.
- ColinWright 8y agoI wasn't explaining, I was just talking about the formatting which was originally wrong, and is now corrected. And sure you can find it weird, lots of people do, but the reply by DoctorOetker was trying to point out reasoning which, when properly internalised, can make it feel less weird. Some people - possibly you included - never lose the sense of weirdness. I have. But in truth, sometimes we never really understand things, we just get used to them. For me, maybe this is one of them.
- phaemon 8y agoI'm not annoyed at all and added the smiley to try and soften my post. I got the Monty puzzle straight away (brought to my attention by Cecil Adams when I followed the SDMB) but I find it interesting to understand why so many intelligent folk get it wrong. As for understanding; the stack exchange question on whether it's coincidence that the value of G is approximately pi squared is one of these things I bear in mind whenever I think I understand something. : ) Edit: and if I'm not mistaken, you once spent far more time than I would have the patience for explaining how this worked to a rather offensive young person. I admired your patience there. It was more than I had and had better results.
- hedgedoops2 8y ago> I then say clearly that I will remove 6 of the other cups and, to retain the mystery, will not reveal the prize Do you say 'I will now remove 6 empty cups?', or is it believed that you removed 6 unmarked cups at random?
- ColinWright 8y agoI can't understand how you can quote my text and still ask that question. Seriously, given that I say I won't reveal the prize, how could anyone believe that I would be removing 6 cups at random?
- FPGAhacker 8y ago"I am not able rightly to apprehend the kind of confusion of ideas that could provoke such a question." --Charles Babbage
- hedgedoops2 8y agoI misread it, as: > I then say clearly that I will remove 6 of the other cups. And, to retain the mystery, I will not reveal the prize. It wasn't a criticism. I just wanted to draw attention to the point that in the random game (I.e. player marks two, you reveal 6 random unmarked, if no prize is revealed, player decides to switch to one or to keep two) it is the better strategy to never switch. Do you think it would be an interesting variant to play the game like that?
- thatthatis 8y agoAs written, it is ambiguous. You say you don’t reveal the prize, but one can remove six cups at random without revealing their contents. “Removing cups” is not the same as “removing empty cups.” If the rules of the game permit you to remove the cup with the prize, it is significant. I think the math and optimal strategy changes.
- ColinWright 8y ago> You say you don’t reveal the prize, but one can remove six cups at random without revealing their contents. One can, but one cannot guarantee it. Actually, one can. One can choose 6 at random from the ones that are neither selected, nor hide the prize. My point is that my phrasing is, I believe, sufficient to allow the listener to determine that I will turn six cups without revealing the prize. In particular I say that I will remove 6 of the other cups and ... will not reveal the prize. I honestly don't see how that can be interpreted in any way other than to say that I will deliberately not turn a cup that reveals the prize.
- dekhn 8y agoI recall this happening; in fact, I though she was wrong when I read the original article. After many years, I finally understood where I made the mistake. It's not stated explicitly in the wording of the problem, but if you point this out explicitly, nearly everybody changes their mind: When Monty Hall opens the door, he has to pick one of them, and he has knowledge of what's behind it. The way the problem was described, I didn't appreciate that. It wasn't until one of the groups that wrote in to support Vos Savant explicitly said "since some of the students in the class were skeptical, we wrote a simulation of the problem, which output the probabilities you would expect if Vos Savant was right." I inspect the source code, and viola- instantly understood my false assumption about the problem description. It's an open problem whether the Monty Hall problem should explicitly state the implication of which door Monty opens. To me, I think the whole point is that it leaves one of the consequences unstated, and the reader is expected to make that indirect inference.
- lookACamel 8y ago>Suppose you're on a game show, and you're given the choice of three doors: Behind one door is a car; behind the others, goats. You pick a door, say No. 1, and the host, who knows what's behind the doors, opens another door, say No. 3, which has a goat. He then says to you, "Do you want to pick door No. 2?" Is it to your advantage to switch your choice?
- dekhn 8y agoThere's actually some ambiguity here (I'm sorry, I'm a really pendantic person). What it doesn't say is that he always picks the door with the goat. What it says is that in a single trial, he picks the door with a goat. I assumed that in half the trials, he'd pick the door without a goat. I see now that was a wrong (and dumb) assumption. This is why, rather than reading text, I think people should describe these problems with code. Unambiguous code. With test cases. Then everybody can inspect the unambiguous code rather than having to parse human text.
- zzt 8y ago
- gameswithgo 8y agoI recall this happening as a high school kid. I couldn't tell from the arguments who was right or wrong, so I wrote a simulation, which was fairly easy, and proved her right. I found it interesting that writing an simple program in this case could confirm the right answer easily whereas having a PHD in math was no guarantee that you would reason it out correctly
- masswerk 8y agoThis is actually a good example for a problem where simulation does exceedingly help in gaining insight. I once did a webpage [1] comprising both logic and simulation to sort out a dispute. (The debating parties each had a PHD in philosophy, implying some courses in logic absolved – which apparently didn't help much with the specific problem.) [1] https://www.masswerk.at/misc/montyhall/ https://www.masswerk.at/misc/montyhall/
- MereInterest 8y agoThe key aspect, I think, is in writing the simulation oneself. At one point, I was attempting to explain the Monty Hall problem, and wrote a simulation out of frustration. It failed to convince the other person, who accused me of subverting the simulation such that it would give the answer that I wanted. I'm wondering if gambling would be a good way to go about it. Start with $10 each, and alternate who plays the "host" of Monty Hall. One person is only allowed to switch, and another is only allowed to stay. For each correct answer, take $1 from the other person. Hmm, maybe to sweeten the deal, the person who switches gets $2 for a win, but the person who stays gets $3. That way, it would show that even with 50% better payout, it doesn't overcome the 2x difference in odds.
- gameswithgo 8y agoThat is true, if is only convincing for people who can understand the code.
- ci5er 8y ago
- ameliaquining 8y agoSomething similar happened a few years later with Fermat's last theorem, except that time vos Savant was wrong. (She didn't believe Wiles's proof.)
- mmusson 8y agoWhich version? Because his first version of the proof had an error that he had to go back and fix.
- beder 8y agoShe was claiming something more fundamental (and less sophisticated) than that. Nigel Boston and Andrew Granville wrote a review [1] of her book that distills some of the problems with her argument. A sample quote: > In fact, her central theme is that non-Euclidean geometry, and indeed any mathematics related to non-Euclidean geometry, is nonsense. [1]: http://www.dms.umontreal.ca/~andrew/PDF/VS.pdf http://www.dms.umontreal.ca/~andrew/PDF/VS.pdf
- DoctorOetker 8y agowell thats not really similar, since in the first case, a large portion of the respondents turned out to be mansplaining (referencing her sex for example). I don't think the situations are similar... Also, her problem and solution are concise to verify, I have yet to see a mechanized version of Wiles' proof. (I am willing to believe it when I see that, but until then I too have a hard time accepting the proof... but of course if an oracle put a gun to my temple and I had to guess, I'd be with Wiles...)
- iamjdg 8y agoWhat I don’t get is in the first table, game 3 and game 5 no longer exist after he opens doors 3. The auto can’t be behind door 3, because he revealed there is a goat there. So yes, relative to the original choices, she is correct. But we have been presented with new information, so if you reset the problem based on the new information, don’t we now have a choice between 2 doors, one with a car and one with a goat?
- alangpierce 8y agoI think the second table is more clear than the first, since it shows that Monty Hall's choice depends on your choice. The main nuance to this problem is that Monty Hall is not picking randomly. There's always some unpicked door with a goat, and he'll pick that one to reveal. So if your original choice is door #1, then when deciding to stay or switch, you're really deciding whether go with door #1 or with the better of doors #2 and #3 (since the worse of the two doors has already been shown to you).
- speakeron 8y agoThat's how I got to understand it when I first heard about the problem in the early 90s. (Of course, I also wrote a simulation.) The problem itself can be rephrased in an even simpler manner where Monty doesn't open any doors at all. Once you've picked a door, he then gives you the option of either staying with that door or changing to both of the other doors (where you get to keep the best prize behind them). Given that formulation, almost everybody would switch.
- ColinWright 8y agoThe information you have gained is not about the door you've chosen. It doesn't matter what door you choose, the host can always open a door to reveal a goat. So there is no information given about the door you've chosen, so the chances of that door containing the prize remain at 1/3. But you have been given information about the door he didn't open, because he didn't open it. That's why it's possible for the odds on that door of holding the prize can change. And yes, we do now have a choice between two doors, one with a goat and one without. The error is in believing that these are equal choices. I roll a die, and you can choose "1" or "not 1". You have two choices, but they have unequal chances of being correct. Similarly with the doors. Just because there are two choices, they may have different odds. In the Monty Hall problem, they do.
- mabbo 8y agoIgnore the fact that it was the Monty Hall problem- everyone on HN has played that topic back and forth ad nauseum. But look at the real story here: thousands of men going out of their way to write letters- not quick 5 minute emails, but paper letters with envelopes and stamps- to tell a woman she was wrong. If it had been a man writing the article, would it have gotten the same reaction? I doubt it. In my view, this is the crux of the gender problems we see in tech today. Certainly not as strong (one hopes) but certainly the same weird psychological problem that so many of us seem to have to some degree requiring men to tell women when they're wrong, but not care when men are. 'GamerGate' and the various witch hunts around that topic is a great example. It's fine if a man sucks at his job, but if a woman does and it's a role that society has labeled 'for men', suddenly it's an emotion-driven attack that must be defended vigorously. We need to see this and watch for it if we're ever going to end it.
- ModernMech 8y agoIt wasn't just any woman, it was a threatening woman -- the "smartest" woman. They were so eager to prove her wrong, they didn't stop to even spend 5 minutes to brute force the problem. She seemed intuitively wrong, they couldn't even consider that the "world's smartest woman" saw something they, exalted PhDs, did not.
- zzt 8y agoIndeed, and we still see the same behaviour in many male-oriented public forums, including this one. And of course the subsequent denial of their own sexist and misogynistic behaviour. "It was nothing to do with her being a woman!" they will cry, ignoring the unconscious bias that led them to such an angrily disproportionate response in the first place.
- deleted 8y ago[deleted]
- ModernMech 8y agoYeah, I'm pretty sick of it to be honest. The culture in silicon valley and its online reflections is pretty toxic and off putting.
- ModernMech 8y ago"You made a mistake, but look at the positive side. If all those Ph.D.’s were wrong, the country would be in some very serious trouble." So then we're in very serious trouble?
- Sharlin 8y agoNo, the person who said that was wrong on both counts. Turns out they were all wrong but that doesn’t really matter.
- DoctorOetker 8y ago>In the proceeding months, vos Savant received more than 10,000 letters -- including a pair from the Deputy Director of the Center for Defense Information, and a Research Mathematical Statistician from the National Institutes of Health -- all of which contended that she was entirely incompetent So the Deputy Director of the Center for Defense Information failed to estimate a concise problem in an ideal setting, but somehow the world is supposed to believe in Mutually "Assured" Destruction in a messy high complexity real world setting?
- Sharlin 8y agoTurns out people have evolved in an environment where it’s really adaptive to be able to manage messy ill-defined unquantifiable problems and not at all adaptive to solve quantitative puzzles where you have to shut up and calculate.
- mchannon 8y agoYou can distill the disconnect down to one question. Does Monty know where the car is? (The original article says he does, but this often gets lost in the version people read.) Suggest Monty doesn't, and he opens door #3 to reveal a goat only because it wasn't the door you picked (and it was merely luck the car wasn't there). In that case, it is genuinely a 50/50 shot between the remaining two. Now if Monty did know where the car was, and he wouldn't have opened door #3 if the car had been there, then the 2/3 percentage to switch is intact. To many this seems like a minor (or incorrect) distinction but it's little assumptions (Monty knows) that underpin these gotcha questions. That's one reason why Google-style interview questions irritate me so much. In many of them, there's an implicit assumption that is necessary but never stated. Many of the responses Marilyn got seemed to come from this form of irritation, even if some of the people writing in couldn't express a logical or justifiable basis for their irritation. It's an interesting puzzle, but it's too easily rephrased like a con.
- MilnerRoute 8y agoI always start explaining it like this. "There's a one in three chance you guessed right on the first try." And that just doesn't change, even if Monty Hall opens a door. So not only is there a two-in-three chance you guessed wrong on the first try. Monty is helpfully offering you a chance to switch to the correct/winning choice in the second round.
- mchannon 8y agoBut Monty's only being helpful if I guessed wrong. If it actually was behind door #1, Monty's trying to entice me into picking a goat, and basically being a dick. This is also assuming he could've just opened door #1 right away if it was the correct answer and obviated this whole mess. Monty's free will (an unknown) underpins this entire argument- what choices does he have, and why does he even make me choose a door instead of giving me the car (and the goats) outright? Maybe from a statistical point of view it's better to have Monty pull this shtick, but something that's helpful 2/3 of the time and harmful 1/3 of the time doesn't make the cutoff for helpful.
- bayesian_horse 8y agoSo, technically, the World's Smartest Woman could be wrong (not in this case, because of the mathematical proof, but according to the title). Being smart doesn't mean you're always right, especially when there is no good answer with the available information. But clearly, the responses show sexism at its finest, or worst. Partly, though, many of the men refusing the argument probably honestly disagree with the counter intuitive answer, but they seem to rationalize it with their negative beliefs.
- bayesian_horse 8y agoWhere does a sexist troll get his water? From a well, actually.
- nabla9 8y agohttp://marilynvossavant.com/game-show-problem/ http://marilynvossavant.com/game-show-problem/ It's interesting that kids in elementary schools were getting this right in many schools. Probably because they worked it trough and did experiments to verify it. Something that was beyond people with many PhD's. It's the lesson for being intellectually humble.
- alangpierce 8y agoThe letters quoted in the article are frustrating to read. It doesn't really matter that she was right, people shouldn't have sent those letters even if she was wrong. Especially in probability and statistics, but also in pretty much every area of knowledge, it is common for human beings to hold strong beliefs that are completely wrong or seriously misguided, and we all need to recognize that weakness in ourselves. I think the world would be a much better place if we all dropped our egos and approached these sorts of disagreements with kindness and benefit of the doubt. Even if we're confident that we know better than the other person, we should approach it as a genuine attempt to understand and clear up the misconception as a way of improving the other person (and be willing to admit that the "misconception" may end up being true after all, as in a case like this). As far as I can think of, condescension is just some obnoxious human habit and doesn't actually provide any value.
- indigodaddy 8y agoAnother way to think about it: Your initital guess (which was 1/3 probability) would have had to have been right, to make it not correct (or not the right choice) to move over to the other door. So moving to the other side (essentially you are just moving over to the 2/3 "probability block"; you were originally on the 1/3 "probability block"), inherently moves your odds over to 2/3. Staying only makes sense if you think you guessed correctly initially, and what are those odds, well those odds are 33%! And what are the odds of anything other than that initial guess (eg moving over) ? Well those odds would be 2/3! This is the only way that I was able to wrap my brain around it. We actually did it by just doing an A B C guess three times in a row. My wife picked a letter. Then I picked a letter. It worked three times in a row, because I never initially picked the letter she did. So three times in a row, me moving over to the remaining letter (after the letter that neither of us picked had been eliminated; obviously we kind of got lucky in me not picking her letter in three tries), ended up of course as being the letter she had picked. Moving over doesn't work only when you actually choose correctly initially, which would only be 1/3 of the time. So again, moving over makes your odds 2/3. It's brillantly simple really, yet extremely difficult to get to a method of actually understanding it, and this is the best way I've found.
- rachelbythebay 8y agoThis sort of thing still happens. Right here on HN, even.
- 1in3tolose 8y agoDiscussed to death: 1st explanation: You have a 33% chance to pick car right away, if you switch then you lose. In other words, you have a 33% chance to lose if you always switch. 2nd explanation: You have a 66% chance to pick goat, game master will eliminate the other goat, if you switch you win
- deleted 8y ago[deleted]