9 ms·
Here's a similarly simple question that I used on hundreds of people who were trying to get a job at a hedge fund: You have a dice (1-6). Some guy offers to pa
by lordnacho 11y ago
Here's a similarly simple question that I used on hundreds of people who were trying to get a job at a hedge fund:
You have a dice (1-6). Some guy offers to pay you whatever you roll. What are you willing to pay to play this game?
Somehow, most of the applicants, who all had quantitative degrees, never made it very far. It's actually a warmup (what would you pay for the same, but with a chance to re-roll once?).
I just don't believe that people can't figure out the expectation of a dice roll. It makes no sense to me. Over the years I've concluded it must be because the way it's asked. People think there's something deeper in it than the most straightforward explanation. Or maybe they think they missed some critical detail and are afraid to ask.
Now there are actually some clarifications that would make it more interesting, but I never got anyone to ask those (Is it an eternal game? Do I have a limited pot?).
What was really dispiriting was when someone understood it, and were shocked we'd asked it.
- JoeAltmaier 11y agoI'm willing to pay $0! No, really, statistics are unintuitive and most people, smart people, don't have a feel for them. Just look at the HN thrash whenever the Monty Hall problem comes up. Btw its a 'die'. 'Dice' is plural.
- apalmer 11y agoYeah but he specifically said these are folks with quantitative degrees... I would expect want to be quants applying at a hedge fund to have an understanding of statistics.
- lordnacho 11y agoOr high school students with a class in basic probability. All I was after was the expectation, just as a quick warmup. No fancy talking about utility functions and all that. And it really was meant to make people feel at ease.
- meragrin 11y agoYes, but there is a difference between expected payout and a person's willingness to play a game of chance. The expected payout of a lottery ticket is the same for every ticket before the drawing, but everyone has a different willingness to purchase tickets. The person is being asked about their willingness to take on risk and not their objective analysis of the payout.
- dragonwriter 11y ago> Btw its a 'die'. 'Dice' is plural. Most current dictionaries disagree and accept either "die" or "dice" as singular, with "dice" also being plural.
- JoeAltmaier 11y agoYes, I'm sure in usage, dice is abused constantly.
- jdmichal 11y agoWelcome to linguistic prescriptivism [0] vs descriptivism [1]. Your line of comments falls into the former camp, but you should be aware that such views are not universal. [0] http://en.wikipedia.org/wiki/Linguistic_prescription http://en.wikipedia.org/wiki/Linguistic_prescription [1] http://en.wikipedia.org/wiki/Linguistic_description http://en.wikipedia.org/wiki/Linguistic_description
- madcaptenor 11y agoEven if you have no risk tolerance, you should be willing to pay up to $1.
- JoeAltmaier 11y agoWho says what I'm willing to do? I'll admit You are willing to pay $1. The question was malformed. Should have been, how much can you pay and still make money, on average? Or better yet, what is the break-even point.
- ilzmastr 11y agofor those who want more, from: http://www.amazon.com/gp/product/0994103867/ref=pd_lpo_sbs_dp_ss_1?pf_rd_p=1944687462&pf_rd_s=lpo-top-stripe-1&pf_rd_t=201&pf_rd_i=097005520X&pf_rd_m=ATVPDKIKX0DER&pf_rd_r=1YRHKCXEX0NWK7G5X57J http://www.amazon.com/gp/product/0994103867/ref=pd_lpo_sbs_d... chapter 4
- DenisM 11y agoIt's a really nice question! It lends itself to starting with simple answers and gradually building up to a more elaborate and more precise answer. Even absent any stats knowledge you should be able to pledge at least 99 cents per roll, as you're always getting at least a dollar back, right? Woo! I'm winning already! :) I'm surprised people are having trouble even getting started. Perhaps the interview setting is intimidating? You should run a couple of friends-of-friends through it, and then ask your friends how the subjects felt.
- chubot 11y agoIf I were completely rational, something less than $3.50, since that's the average of $1 to $6 ? Is that it? It does seem too simple, or otherwise the wording threw me off too.
- lordnacho 11y agoThat's all I was after.
- boobsbr 11y agoIsn't $1 a valid answer? I'm willing to pay $1, because the lowest amount I can win is $1, and I'd have a net loss of 0.
- talmand 11y agoWell, for that matter, why pay $1? Offer a cent per roll and you're guaranteed a significant payout as compared to your payin every single time.
- random28345 11y agoAnd to continue the questioning, if you have one reroll, and we assume you reroll a 1-3, then the expected value is (3.5 + 3.5 + 3.5 + 4 + 5 + 6) / 6. I'll take that hedge fund job now.
- talmand 11y agoAt first I was thinking of something along those lines, averages. I'm not a math guy so I was thinking there was more to it since I didn't know other aspects of the situation; such as my limit, the other guy's limit, and so on. I think my answer would have been, especially without more data, to not play the game. After living in Vegas for a number of years I know that even though the house often provides favorable percentages, the house always wins in the end. But with some more wording, this could be a clever brain teaser. Thanks for bringing it up.
- deleted 11y ago[deleted]
- lordnacho 11y agoYou won't know that hundreds of people will get tripped up until you have a reasonable sample. There's always the competing hypothesis that the people you invited are actually thick.
- alienasa 11y agoThe dice roll question is a pretty effective method of determining if someone understands the concept of expected value. I'm not certain, but I'm guessing that's an important concept in hedge fund land. Sure, it might be a trivial question, but it's neither a "trick", nor useless.
- deleted 11y ago[deleted]
- meragrin 11y agoAs stated, it is a trick question. There are too few details and ends with asking for an opinion. One person's willingness rarely is the same as the average expected outcome.
- dragonwriter 11y ago> You're asking people stupid questions about a dice roll in an interview for a hedge fund, may have well be asking them for the 1965 Shirelles hit, both are equally relevant. No, the Shirelles hit is irrelevant trivia that shows only memorization of irrelevant material, the dice roll question is a dirt-simple application of the kind of quantitative reasoning required for the job in question. They are not, even loosely, analogous.
- MichaelGG 11y agoThat's disappointing, if you just meant for them to sum up the sides and divide. But at first I thought you meant to figure out the probability of the die being loaded - after the first roll, there's a higher chance of getting the same number than any other. Plus I'm assuming the physics of a loaded die don't just influence one side, but have a non uniform effect. Or maybe by "you have a dice" it means it's mine, and I know it's not loaded (I doubt I'd know, and the cheap DnD dice I own are probably not casino quality). So maybe this guy is trying to take advantage of known quality issues in common dice. For instance. the extra pits on the higher valued sides mean that side is lighter, thus has a higher chance of coming up, right? (The side with 1 pit weighs the most, so I'd expect some bias towards rolling a six.) Cause if we assume the person offering me money has an angle, well, there's gotta be something, right?
- chippy 11y ago> You have a dice (1-6). Some guy offers to pay you whatever you roll. What are you willing to pay to play this game? Could you rephrase the question please, as this is what I take from the above: Firstly, why should I pay to play it, if some other guy is offering to pay me anyhow? All I would pay is the same unit of time spent rolling the die. If the time taken to roll a die is worth less than the payout for rolling a 1, then any roll is going to make me money. If it is more then the payout for rolling a 6 then it's not worth rolling at all, and if in between - that's where some gambling comes into play.
- nilkn 11y agoI'm sure you'd get a higher pass rate if you just asked for the expected value of rolling a die. People most likely don't pass because they don't realize that's what you're looking for. The question is phrased in a more confusing way. You have to realize that what the question really means is more like this: if you were able to play this game repeatedly, what's the most you'd be willing to pay for each time so that you don't lose money on average over time? For what it's worth, simply asking "how much" you'd be willing to pay is fairly confusing, because ideally you wouldn't pay anything. This isn't astoundingly hard or anything, but anytime the candidate has to "rewrite" the question the pass rate is going to go down. I'd recommend setting it up as a carnival game and phrasing it from the perspective of the carnival, not the player. Ask for the minimum price the carnival needs to charge so that they can be confident they at least won't lose money on average over time.
- bloaf 11y agoIf the person's job is going to be taking well defined problems like "find the expected value of x" and solving them, I'd rather buy software. I would actually want an interview to weed out people who were unable to re-parse confusing real world input, like that problem. I would want employees who could, as a matter of course, take a somewhat ambiguous situation, choose relevant tools (e.g. expected value,) and render a judgment.
- nilkn 11y agoSure, that's fair, but lordnacho has not specified exactly what he means when he says that the candidates failed. Did they just sit there blank, completely stunned? Did they ask any questions at all? We also do not know his interviewing style. Some interviewers are very averse to clarifying the problem, which will backfire big time with a question like this.
- ryandrake 11y agoAsking an imprecisely worded question is sometimes a good way of weeding out people who expect every little requirement defined up front before they work on a problem. Any idiot can say, "ERROR. Your question was worded ambiguously, please re-state with more detail." Often the better candidate is willing to ask clarifying questions and/or make (and state) reasonable assumptions and move on.
- discardorama 11y agoI'd pay 0 to play it, and get $3.5 back (on average) on each roll. Nowhere does it say that the 'some guy' can refuse your offer.
- shabble 11y agoNow that's finance-industry thinking! In fact, does the cost even need to be non-negative? Why not demand a 'playee fee' to be added onto your winnings.
- yellowapple 11y ago> You have a dice (1-6). Some guy offers to pay you whatever you roll. What are you willing to pay to play this game? Is the correct answer not "1"? That would be the maximum I'd be willing to "invest" if that's the highest number that's actually guaranteed.
- shabble 11y agoIs it a fair die? I'd be naturally suspicious of anyone offering me 'free money' in such a game. But, assuming it was legit, presumably < E[x] = $3.50/game, assuming a decent number of games to average over. If it were a single game, I'm not entirely sure how I'd play - 3/6 outcomes result in losing money at $3.50, but where between $1 (always win - who would play against you?) and $6 (best reward, but -$5 potential loss) I guess that depends on your personal risk tolerance. On your second point - I think I did originally misunderstand the question, and only on re-reading did it actually make sense. I hope I'd ask for clarification in an interview situation, or at least confirm my understanding is correct if it seemed off.
- msane 11y agoThat's funny, and totally believable. Still a great question. Speaking of economics fizzbuzz type interview questions can be understood in terms of risk. People second-guess themselves when asked simple questions which directly addresses their intelligence in the early interview phase because the stakes are suddenly total. The risk of answering a simple question incorrectly is disqualification.
- z3t4 11y agoI would say "Tell me more about that guy".
- meragrin 11y agoThe question is very misleading. There are very little details and you end with asking for an opinion. It sounds to me like a question about how much risk the person is willing to take rather than a math question. The "What are you willing to pay to play this game?" really needs to be replaced with something else. I would never associate this with a math question unless risk tolerance was included in the details. Any questions I might ask would not clue me into it being a math question either.
- stordoff 11y ago> You have a dice (1-6). Some guy offers to pay you whatever you roll. What are you willing to pay to play this game? The thing that would trip me up there is the "what are you willing to pay[?]" part. Instead of just interpreting it as "what is the EV of a fair six-sided die roll?", I start thinking about complicating factors immediately: * utility function (I wouldn't pay the EV to play as I'd want to expect a profit - if you asked for the break even point/most you would be willing to pay, you would probably get a quicker answer) * Why pay? He's already offered to pay me :p * Do I know it is a fair die? * How much money do I have? * How many times will the guy pay out? Once, infinitely, or stop after some arbitary/unknown amount? I'd hope that someone with a related degree would at least have a similar sort of discussion (or offer the EV as the answer initially then have some sort of discussion), but I can see why some people who 'should' know the answer might be tripped up by it.
- lizard 11y ago> Over the years I've concluded it must be because the way it's asked. People think there's something deeper in it than the most straightforward explanation. Or maybe they think they missed some critical detail and are afraid to ask. I like your conclusion and I think it's something anyone involved with hiring practices should think about more. I don't know if I'm the type of person a hedge fund would be looking for, but I would freeze on that question: My first thought would be, I wouldn't be willing to pay to play the game with "some guy" at all. But knowing that's probably not what you're getting at, instead I'm going to have to look for a solution to a problem I've never encountered. But it goes deeper than that: If someone were to walk up to me and offer to play the game I just could say "No, thanks." and life goes on, a simple and low stress life decision. In a job interview I may be desperate, or at least hopeful, for the job; no thanks isn't going to cut it. You may not realize it, or intend it, but your warm up is asking how I face new challenges in life. No pressure. Since the situation is new and hypothetical I've also got to consider the hypothetical details. These hypothetical details can branch widely and deeply, reaching into both the hypothetical world you've prompted and the reality that I'm being evaluated without knowing what you are looking for. E.g. Is it a loaded die? That would mean the question is loaded so, no that's a silly question; unless that's exactly the kind of thinking you're looking for, in which case it's an essential question. Further, I know you already know the answer, and the trick if there is one, so the question might seem simple to you and you might not understand why I don't also just get it (which you admit). This means bad starts and bad questions can make me look bad which I definitely don't want (So, yes, I think there may be a critical detailed I missed, and I'm afraid to ask). This probably isn't how you or other interviewers intend for candidates to respond to questions. One solution is for candidates to work on "interviewing skills" and get better at provided simple, canned answers. This makes sense if these interviewing skills part of the job but otherwise, in my opinion, distracts from exploring the candidate's talents and doesn't really give a good sense of company fit. Alternatively, the interviewer could make their intentions and expectations clear for the candidate. For example, send the candidates your warm up questions a week in advance to let them prepare for the interview. When they get there ask them what they came up with and then probe them with deeper questions that get at what you really want to learn. Those who worked on your problems will be better prepared to talk about it. I would like to see interviews try to draw out the skills the candidates possess and determine if they would benefit the company, rather then being a Company Exam. This might mean letting the candidate actually work with the team on a small problem, or just providing guidance and feedback to help them feel more comfortable talking with you rather than feeding you answers. For example, step them through the original dice game and then ask them to consider the variations. EDIT: Fixed typos.