3 ms·

Does anyone have actual metrics about whether this stuff works or not? All I see is anecdote after anecdote in both directions. In god we trust, all others mu

Does anyone have actual metrics about whether this stuff works or not? All I see is anecdote after anecdote in both directions. In god we trust, all others must bring data.

AstralStorm 4y ago
The problem is that leetcode in itself is not a calibrated test. So, given any particular leetcode score, assuming the person is there, tells you literally nothing about skills involved. Big corporations do not use it, and they would be most likely to have actual also likely untranslatable employment data. Then there are specifics of any job - knowledge of particular system or rapid learning and experimentation skills tend to trump optimization and algorithmic knowledge. Leetcode does not really test any of that. It is also particularly bad at weeding out cheaters. :)
Jensson 4y ago
Googles interviews works according to their internal data. Google bans any questions that you can find on the internet though, including all questions you find on leetcode (they have people who check this, including the member only questions), they want to ensure that candidates only do problems they haven't seen before. Some accidents still happens, but since they have 5 interviews per candidate it is very unlikely for anyone to pass without solving a few problems they haven't seen before. So the process works when the candidate hasn't seen the exact problems before. For those who just gives leetcode questions verbatim it might be less effective, or even counter productive, I haven't seen any data on that.
- deltaonefour 4y ago
  That's what they say. I want to see the actual data. I think part of the problem is that really in order to get proper data.... You have to actually hire the people who failed the interview. So i actually doubt google has any good internal data. Not unless they hired a bunch of people who failed.

Does anyone have actual metrics about whether this stuff works or not? All I see is anecdote after anecdote in both directions. In god we trust, all others must bring data.

AstralStorm 4y ago

The problem is that leetcode in itself is not a calibrated test. So, given any particular leetcode score, assuming the person is there, tells you literally nothing about skills involved. Big corporations do not use it, and they would be most likely to have actual also likely untranslatable employment data. Then there are specifics of any job - knowledge of particular system or rapid learning and experimentation skills tend to trump optimization and algorithmic knowledge. Leetcode does not really test any of that. It is also particularly bad at weeding out cheaters. :)

Jensson 4y ago

Googles interviews works according to their internal data. Google bans any questions that you can find on the internet though, including all questions you find on leetcode (they have people who check this, including the member only questions), they want to ensure that candidates only do problems they haven't seen before. Some accidents still happens, but since they have 5 interviews per candidate it is very unlikely for anyone to pass without solving a few problems they haven't seen before. So the process works when the candidate hasn't seen the exact problems before. For those who just gives leetcode questions verbatim it might be less effective, or even counter productive, I haven't seen any data on that.

deltaonefour 4y ago
That's what they say. I want to see the actual data. I think part of the problem is that really in order to get proper data.... You have to actually hire the people who failed the interview. So i actually doubt google has any good internal data. Not unless they hired a bunch of people who failed.