8 ms·
How I build and run behavioral interviews
- doodaddy 3y ago[dead]
- SkyMarshal 3y agoIs there any way to filter out high-drama people from low-drama ones? I've come to appreciate people who are chill, low-drama, professional, and focused on the tasks at hand. People who, even when they hold strong opinions about something, are willing to work through a group problem-solving process that aims to build consensus and buy-in around the eventual solution. Can behavioral interviews consistently identify those people, filter out their opposites, with minimal false-positives?
- SebFender 3y agoThese types of questions are somewhat simple to go into in smaller teams/projects/companies. It becomes very complex in large enterprises where politics and nepotism plays a role. It's all good in theory. My approach is more based on values, morals, priorities, way of life and so on. This has enabled me to gather great individuals working in poor environments...
- paulsutter 3y agoStrong recommend to use these techniques when interviewing. For example: employees from large companies may claim credit for substantial initiatives but when you drill in they had only a tangential involvement. They don't intend to mislead, thats just the language people speak inside of large companies, and behavioral interviewing can help translate that into more objective information.
- tines 3y ago> To figure out whether they’re real or BSing you, the best way is to get them to tell you a lot of details about the situation—the more you get them to tell you, the harder it will be to BS all the details. This is exactly the feature that allows people to distinguish a genuine recording from a faked one in Iain Banks' sci-fi series "The Culture"---it's impossible to fake a recording taken by a (machine) Mind because there's too much detail to fabricate.
- lamroger 3y agoI've had a few of these interviews. Some do it well by showing genuine interest and maybe they have expertise in the area and it's fun chatting about the project. Other's see it more like cross examination or make it adversarial. I personally get nervous and tense up when I feel attacked. Maybe it's a good way to opt myself out of working in those environments.
- athoscouto 3y agoThis is spot on. Having shadowed my share of interviews, I've found that the attitude of the interviewer is the biggest factor in having a good interview experience. Making sure interviewers show genuine interest, and are open to different candidate background is one of the most difficult things to guarantee when you have many people interviewing.
- dilyevsky 3y agoMy personal experience has been that people dramatically underestimate how easy it is to bs and simultaneously overestimating their ability to tell if someone is bs’ing vs just being nervous/forgetful. Which leads to some hilariously poor outcomes…
- humblepie 3y ago[flagged]
- pan69 3y ago"A rubric is a type of scoring guide that assesses and articulates specific components and expectations for an assignment." I don't think there is an "overuse". It's just using the word rubric instead of something like scorecard or checklist.
- deleted 3y ago[deleted]
- digging 3y agoI've almost never been part of an interview so well thought-out, but I continue to hope to be. I find this is also helpful reading for candidates.
- riversflow 3y agoFrom the examples section: > making their reports feel psychologically safe > ask how they thought their report felt after the tough convo > bad answer = not sure, or saying things in a non-supportive / non-generous way I wouldn’t feel “psychologically safe” with someone who expects me to read minds. How can you ever be sure about how others feel as a manager? I check in with my reports and their colleagues but I’m still never certain. Your reports don’t want to be fired and as such every interaction you have with them is flavored with coercion. If I asked this question and they didn’t say something to the effect of I’m not sure, that would be an enormous red flag to me that this person doesn’t give others proper agency.
- sarchertech 3y agoThis sounds like an honest attempt to be more objective, but it’s still so subjective that I question the value. >Vague platitudes: some people have a tendency to fall back on vague generalities in behavioral interviews. “In recruiting, it’s all about communication!” “No org structure is perfect!” If they don’t follow this up with a more specific, precise or nuanced claim, they may not be a strong first-principles thinker.” I don’t think that conclusion follows. I think what is usually happening there is that the person is saying what they think you want to hear. Ironically the phrase “first principles thinker” sounds like vague business speak to me.
- ordu 3y agoThe point of interview is not to be objective or something like, the point is to maximize chances for a good hire. Your chosen example is the one of several, and don't forget it is an hour of talking. No one decides on this answer alone. From other hand if it is so hard to get some kind of behaviour from an interviewee then maybe it is really not their kind of behaviour? Not something they would do naturally without nudging? Judging by my own experience, it is hard to me to hide my normal way of thinking, it needs some conscious effort, and if given an excuse to talk along my normal line of thought I would do it. And if I was nudged to do it and I didn't because I thought it is not the right time or place for it, then it would be a pathetic inability to read a situation I'm in. Anyway it is all probabilistic judgements, you cannot get anything certain in a psychology. But if you got a bunch of probabilistic signals then you can decide probabilistically. And you cannot get anything "objective" in psychology. Everything is subjective, even formalized tests. To this day people have no test that allows to decide if there is a human on the other side of a communication. The best we have is Turing Test which is laughable excuse for a test, not an objective measure. We cannot reliably measure a difference between human and non-human, how could we hope to measure reliably a difference between a good hire and a bad one?
- sarchertech 3y ago> how could we hope to measure reliably a difference between a good hire and a bad one? We can’t. That’s my point.
- neilv 3y ago> The second sentence (context/problem/solution) is important for helping the candidate keep their initial answer focused—otherwise, they are more likely to ramble for a long time and leave less time for you to... Dig into details How about, instead of asking "Tell me about a time you...", and you presuming to understand the situation so well that you can make judgments about nuance based on the off-the-cuff example you asked for, and trying to cut them short from "rambling"... You instead ask them "Say you have a situation like X; how would you approach it?" And you can change the situation by adding information, "What if the report responds Y?" Then both people are operating from closer to similar information about the situation. (Though it's still possible that the interviewee understands something about these situations in general that the interviewer doesn't.) This also avoids dredging up past unpleasant situations (someone with more experience will have handled more unpleasant situations, but that doesn't mean it doesn't invoke a somber mood, if they're not acting or oblivious). It also means they don't have to also think about how much they can say under NDA and being discreet about personnel matters (while a poor interviewer might take hesitation or choosing words carefully as interviewee trying to put themselves in the best light or keep a fabricated story straight). An expected objection to this approach of spinning a hypothetical situation is that candidates might just say what they think are the correct answers. But knowing the correct answers is at least half the problem. And what do you think many candidates are doing in the interview anyway, if they are the kind to know the correct answers, but not follow them in real life.
- ItsMattyG 3y agoBecause it empirically doesn't lead to as good hires as asking about past experiences.
- deleted 3y ago[deleted]
- volkk 3y agoproblem with hypotheticals is most people can give an ideal way to handle a situation, but when the actual scenario presents itself, they deal with it in a non ideal way. I'd like to find out what that non-ideal way is and if the delta is small enough, then that person meets the bar. i can also add supplementary questions if i didn't get enough of a signal, such as the one you presented (i.e what do you think you could have done better) should add that the more you dig, the better you can identify where truth/embellishments lay. a reaaaaally good liar is rare and you can somewhat tell across differing kinds of quetsions where the red flags are. just need to create a robust system of questioning. this all sounds dystopian as i write it, but unfortunately that is the nature of interviewing
- purpleblue 3y agoAny guide or blog post on how to interview that doesn't compare interview notes to performance reviews after hiring someone is basically bullshit. Anyone can write a blog post about what they think is a good interview but there's no empirical proof that their interview technique works.
- louwrentius 3y agoTrue to the extend that you'll never get a real evaluation, because you'll never know how the people who were turned down, would have fared.
- MathMonkeyMan 3y agoThat suggests an interesting idea. Figure out what might be meant by "a good employee." This is hard. Maybe factor in tenure, promotions, projects delivered, peer evaluations, etc. Develop of set of measures for an employee's overall all-time job performance. Now take each candidate's "interview binder" and map it to some set of ratings (coding proficiency, favorite ice cream flavor, etc.). Set thresholds for each rating initially to reach hiring targets and some vague notion of an acceptable employee profile. Always allow some small percentage of candidates below the thresholds to receive an offer. Correlate the interview rating dimensions with the set of employee performance measures as employees work through the job. Adjust the interview thresholds and experiment with adding or removing dimensions as you learn which things in the interview are correlated with "good employees." Maybe this is how it's done when it's done properly, but it's the "extend offers to a few people below the cut, and see if they fare worse" idea that I like.
- khokhol 3y agoGood advice overall, and definitely an improvement over the usual interview boilerplate that candidates have to trod through. However, in some places it seems to be too cavalier -- in the sense that it suggests we now have a magic prism with which we can "diagnose" the candidate's shallowness or lack of candor. When really they're just saying something basically innocuous. Cause it's like, been a long and mostly boring interview process so far, has it not, and they're trying to slog their way through the canned / pre-programmed (if arguably necessary) part of the process like you are. For example, under "Things to watch out for": High standards: if they say there’s nothing they wish they’d done differently, this may also be lack of embarrassing honesty, or not holding themselves to a high standard Or they had a genuinely shitty experience (with high costs to finances, relationships and/or health) that was 80 percent out of the blue and beyond their control. And they'd really rather just move on. Or if they did tell you the real context and their real reasons for doing X -- you'd very likely ding them (quite likely fatally) for doing so.
- louwrentius 3y agoThe hubris of those hiring tips & tricks posts never cease to amaze me. Hubris in the sense that they really think that they are doing something right, so much so that they blog/post about it. Yet, if I take this post as an example, I notice a lack of self-reflection about bias en why you would interpret behaviour a certain way and not another. In the end, it's all subjective, and everybody is doing their best, but how valuable is it really? Especially, if you don't know anything about the company/organization that this person is hiring for?
- maximinus_thrax 3y agoI'm sad to have scrolled down so far to see your comment. This type of content is scary and a huge red flag for the company the person works at. I mean it's one thing to experiment/improve/etc.. but to come out with 'the right way' (TM) and publicize is straight-up Dunning-Kruger. Also, > To get a strong signal from a behavioral interview question I usually need around 15 minutes I laughed out loud on that one. I also need about 15 minutes to get a strong signal from any interview question for any candidate, because I am biased and then I challenge my bias for the rest of the interview, because I don't think I'm smart enough to have cracked the 'hire the right people' code. > doing this stuff worked better than not doing it Better for what? Is there a follow-up on the performance of the hire based on doing vs not doing this? Or can it be rephrased to 'doing this stuff gave me a superior sense of confidence about how well I interview people'
- louwrentius 3y agothank you, 100% agreed!
- paulcole 3y agoOne thing that I've noticed makes a difference is to be positive and complimentary to the candidate at the start of the interview. Make it clear that you're excited to talk to them and that you are genuinely excited to hear what they have to say. I've missed out on hiring good people who were nervous or worried about doing a bad job in the interview. I'm sure I still do miss out on some but I've found a method that lets some people feel more comfortable without being overly difficult on me and can live with that.
- quantumensert 3y ago[dead]
- nitwit005 3y ago> Ask how big of an effect something had and how they know. (Example: I had a head of technical recruiting tell me “I did X and our outbound response rate improved;” when I asked how much, he said from 11% to 15%, but the sample size was small enough that that could have been random chance!) Where is this evidence in this post? What beneficial effects did your new behavioral interviewing technique produce?
- deleted 3y ago[deleted]
- VincentEvans 3y agoMaybe it’s just me, but whenever I hear a question like “tell me about a time…” - I simply can’t remember. These routine job-related things just don’t stick out in my mind as something to catalog for some future contrived performance and disappear out of my mind together with other uninteresting and unimportant noise, like a name of the clerk at the DMV or what was advertised during the commercial break when I turned on the TV in my hotel room. I suspect that people who readily jump in with an answer - are the ones you claim to guard against, those who drilled and trained for giving responses to these interviews.
- slyall 3y agoI can still remember an interview that consisted of nothing but those questions and I hadn't prepared answers so I either answered "I can't think of a time sorry" or tried to recall one on the spot. Interview was a train-wreck. Since then I have a bunch written down that I review before I interview. It's like leetcode questions, if you are going to get them during the interview you study for them. You don't expect to naturally solve them without prep.
- jcparkyn 3y ago> if you are going to get them during the interview you study for them And a lot of interviewers (at least in my limited experience) are quite okay with you referencing your notes during the interview.
- VincentEvans 3y ago… which just serves to reinforce the point that the interview becomes a rehearsed dog and pony show where interviewer asks contrived questions that are compiled and put into an “interview prep course” shilled on Linked In, and interviewee “references notes” they prepared from said course on how to best answer said questions. All done while claiming to look for “genuine insight”.
- nico 3y agoExactly Essentially every single interview/recruiting process is selecting for someone who is good at going through the process, rather than selecting for someone who is actually good for the job It’s pretty frustrating and incredibly time consuming You could be the perfect person for a job, but if you haven’t practiced interviewing for a while, you’ll most likely not get the job And the opposite is true. After enough interviews, you’ll get practice, gain confidence and will start looking like the better candidate, even if you are not the best for the job
- selmaertorun121 3y ago[dead]
- abakker 3y agoI don't know. I don't do a lot of job interviews, but I do a lot of research/expert interviews. To me, there is not much distinction and the major takeaway from this post seems to be, "Preparation and objectives are good when doing research"....umm yeah. You're there to find something out, so putting in the effort to know what that thing is and design the questions that can plausibly get you to the answers you want seems like obvious advice. To me, if you are using interviews to determine the best way to spend your $salary_money on a person to get $outcome_stuff, then you really can't be walking into it without first introspecting on the knowns, unknowns, and unknowables of a decision. I'd hate to estimate potential team dynamics from interview responses, but I can absolutely validate that the candidate knows facts they need to know. But, it would take the preparatory effort to understand those things myself. The major thing I take away from this post is the conviction that hiring approaches really don't seem to have progressed.
- joanne123 3y ago[dead]