5 ms·

> what percentage of your correct submissions were from people who didn't even want the job? Probably pretty low. But it's not designed to have a high convers

> what percentage of your correct submissions were from people who didn't even want the job? Probably pretty low. But it's not designed to have a high conversion rate. It's really just to scare off pretenders and the under-qualified. I like to solve "Cover Letter Problems" for fun, but I've never bothered to apply to a company that had them. I don't think that means they're a failure. The applicants themselves probably benefit the most as it gives them a window into the company's dev culture. Cutesy "gotcha!" problems that are abstract and removed too far from coding are generally a warning sign that it's a shop full of people who may be smart but are perhaps mediocre developers and/or the shop has non-technical management. On the flip side, problems that explore an applicants coding style and thought process tends to be an indicator the shop wants actual coders who can get shit done in an efficient manner, and that they care about things like Code quality, their tool chain, and care just enough about process to achieve repeatable results, but not so much as to become dogmatic.

tptacek 15y ago
I can't get my head around why anyone would design a hiring process to "scare off" anyone. Sure, you'll chase away superficial candidates... but some fraction of all the real talent will also blow you off. I really think the problem here is how people do outreach to candidates. I feel like too many companies haven't figured out that recruiting is a marketing problem, just like software sales. Companies get all kinds of creative addressing marketing problems --- but when it comes to hiring, they plug "reqs" into "job boards" and then try to "deflect" the "pretenders". Calibrate your outreach so that you can safely pay individual attention to all candidates. Don't post reqs to Craigslist or Monster or Dice or whatever your HR person --- in fact don't let your HR person near recruiting --- thinks is the place you're supposed to post ads. You will still be giving "early no" responses to lots and lots of candidates, but it'll be manageable, and it'll be very unlikely for your process to cost you talented candidates.
- spamizbad 15y ago
  You're absolutely correct. "scare off" may have been projecting my own biases onto the company based on passed experience. However, overwhelmingly I've found managers are terrified of hiring under-qualified candidates, and often do not make a concerted effort to rope in exceptional people who will obviously shine bright enough to be recognized.
  - tptacek 15y ago
    Which is totally understandable if the biggest component of your recruiting pipeline is leads from job boards. The average quality of a job board candidate is so _low_ that there's a reasonable concern about defining expectations downwards, so that anyone who can talk coherently about programming and solve FizzBuzz might look artificially qualified. The solution to this is, again, have an outreach process that gets you Glengarry Leads, at a much lower volume. Where do your best candidates congregate? What are they most interested in? What do they like to talk about? What do they have opinions about? Think about those questions and then, for God's sake, don't just pick a job board based on them.
- epo 15y ago
  There is a mindset amongst some of the worst sort of managers that "we only want the best people" and so they design hiring schemes or post jobs ads which over specify their needs and/or are designed to stop lesser candidates wasting management time. The end result is often that the best people just walk on by. Honesty in the hiring process cuts both ways.
  - dpritchett 15y ago
    This really depends on the cost structure of the work you're doing. If you're an IT body shop then you really do want middle-of-the-road talent who can work well in a team and won't rock the boat. If you're a smaller specialty shop with a long client list and a reputation for top-notch work then you can't afford a single NNPP.
  - ChristianMarks 15y ago
    Or worse: they overspecify a development job and then expect the candidate to do helpdesk work, fix printers, diagnose NTFS-3G problems in Mac OSX Lion, where it is no longer supported, setup Skype for a secretary who won't learn her job, and become an unlicensed email therapist for a technically unsavvy supervisor who demands a 100% email delivery guarantee from a programmer with no control over email servers.
  - deleted 15y ago
    [deleted]
  - mnoire 15y ago
    I have to agree at least partially. I had better really want (or need) that job to go through the trouble. And at the same time, I find this quite refreshing. The process of submitting resumes is quite passive and limiting. While the effort to create a video might be a more laborious task, I appreciate the opportunity to represent myself outside of bullet points and buzzwords like "spearheaded". There must be some balance here between answering the same questions with the same answers and proving you are sharp, creative, interesting, etc.
- yummyfajitas 15y ago
  I can't get my head around why anyone would design a hiring process to "scare off" anyone. Sure, you'll chase away superficial candidates... but some fraction of all the real talent will also blow you off. This is trivially true of any hiring method - you might scare away a few good people. The right question to ask is "what are the proportoins?" If I can scare away 100% of the chaff and 1% of the wheat, it's probably a win. I can simply hire anyone who survives. If the ratio is less stark, it may or may not be a win, depending on my costs of hiring, how badly I need someone, etc. I'm not saying everyone who uses this tactic is doing it right, merely that it's not a bad idea in all cases.
  - tptacek 15y ago
    If it was 100/1, I'd agree with you, but these are never 100/1 processes; they're cutesy programming quizzes, or video requirements, or lengthy statements of required prior technical experience. Any process that does not cause a cold high-quality lead to come into contact with an engaged human being almost automatically is broken.
    - yummyfajitas 15y ago
      If it's part of a hiring process, it doesn't need to be 100/1. You can chain bad filters together to get a good one - that's the basis of statistical prediction. And incidentally, cutesy programming quizzes are often a very good filter. In my last job, I tried recruiting with one after speaking to too many people who couldn't handle fizzbuzz. The exact quote was "Instructions on where to send your resume are contained in our application (you'll need to decrypt them first)." http://news.ycombinator.com/item?id=1659735 http://news.ycombinator.com/item?id=1659735 It dramatically increased the number of people who wrote to me - I actually got quite a few responses of "neat puzzle, not looking for a job, did I get it right?" And by virtue of not giving out an unencrypted email address, I didn't talk to anyone who couldn't code.
      - tptacek 15y ago
        A false negative in a job filter results in a phone screen with someone who can't do fizzbuzz. A false positive results in a candidate who can e.g. write a kernel memory allocator walking from your process because you're too much of a pain to deal with. Too many interviews, or losing the best possible candidates. I know which one I prefer --- especially because I know when I'm getting too many interviews, and can tune other things (most notably: where I post about jobs) to adjust that. I can't know who I'm losing as a result of my recruiting process being cumbersome.

tptacek 15y ago

I can't get my head around why anyone would design a hiring process to "scare off" anyone. Sure, you'll chase away superficial candidates... but some fraction of all the real talent will also blow you off. I really think the problem here is how people do outreach to candidates. I feel like too many companies haven't figured out that recruiting is a marketing problem, just like software sales. Companies get all kinds of creative addressing marketing problems --- but when it comes to hiring, they plug "reqs" into "job boards" and then try to "deflect" the "pretenders". Calibrate your outreach so that you can safely pay individual attention to all candidates. Don't post reqs to Craigslist or Monster or Dice or whatever your HR person --- in fact don't let your HR person near recruiting --- thinks is the place you're supposed to post ads. You will still be giving "early no" responses to lots and lots of candidates, but it'll be manageable, and it'll be very unlikely for your process to cost you talented candidates.

spamizbad 15y ago
You're absolutely correct. "scare off" may have been projecting my own biases onto the company based on passed experience. However, overwhelmingly I've found managers are terrified of hiring under-qualified candidates, and often do not make a concerted effort to rope in exceptional people who will obviously shine bright enough to be recognized.
- tptacek 15y ago
  Which is totally understandable if the biggest component of your recruiting pipeline is leads from job boards. The average quality of a job board candidate is so _low_ that there's a reasonable concern about defining expectations downwards, so that anyone who can talk coherently about programming and solve FizzBuzz might look artificially qualified. The solution to this is, again, have an outreach process that gets you Glengarry Leads, at a much lower volume. Where do your best candidates congregate? What are they most interested in? What do they like to talk about? What do they have opinions about? Think about those questions and then, for God's sake, don't just pick a job board based on them.
epo 15y ago
There is a mindset amongst some of the worst sort of managers that "we only want the best people" and so they design hiring schemes or post jobs ads which over specify their needs and/or are designed to stop lesser candidates wasting management time. The end result is often that the best people just walk on by. Honesty in the hiring process cuts both ways.
- dpritchett 15y ago
  This really depends on the cost structure of the work you're doing. If you're an IT body shop then you really do want middle-of-the-road talent who can work well in a team and won't rock the boat. If you're a smaller specialty shop with a long client list and a reputation for top-notch work then you can't afford a single NNPP.
- ChristianMarks 15y ago
  Or worse: they overspecify a development job and then expect the candidate to do helpdesk work, fix printers, diagnose NTFS-3G problems in Mac OSX Lion, where it is no longer supported, setup Skype for a secretary who won't learn her job, and become an unlicensed email therapist for a technically unsavvy supervisor who demands a 100% email delivery guarantee from a programmer with no control over email servers.
- deleted 15y ago
  [deleted]
- mnoire 15y ago
  I have to agree at least partially. I had better really want (or need) that job to go through the trouble. And at the same time, I find this quite refreshing. The process of submitting resumes is quite passive and limiting. While the effort to create a video might be a more laborious task, I appreciate the opportunity to represent myself outside of bullet points and buzzwords like "spearheaded". There must be some balance here between answering the same questions with the same answers and proving you are sharp, creative, interesting, etc.
yummyfajitas 15y ago
I can't get my head around why anyone would design a hiring process to "scare off" anyone. Sure, you'll chase away superficial candidates... but some fraction of all the real talent will also blow you off. This is trivially true of any hiring method - you might scare away a few good people. The right question to ask is "what are the proportoins?" If I can scare away 100% of the chaff and 1% of the wheat, it's probably a win. I can simply hire anyone who survives. If the ratio is less stark, it may or may not be a win, depending on my costs of hiring, how badly I need someone, etc. I'm not saying everyone who uses this tactic is doing it right, merely that it's not a bad idea in all cases.
- tptacek 15y ago
  If it was 100/1, I'd agree with you, but these are never 100/1 processes; they're cutesy programming quizzes, or video requirements, or lengthy statements of required prior technical experience. Any process that does not cause a cold high-quality lead to come into contact with an engaged human being almost automatically is broken.
  - yummyfajitas 15y ago
    If it's part of a hiring process, it doesn't need to be 100/1. You can chain bad filters together to get a good one - that's the basis of statistical prediction. And incidentally, cutesy programming quizzes are often a very good filter. In my last job, I tried recruiting with one after speaking to too many people who couldn't handle fizzbuzz. The exact quote was "Instructions on where to send your resume are contained in our application (you'll need to decrypt them first)." http://news.ycombinator.com/item?id=1659735 http://news.ycombinator.com/item?id=1659735 It dramatically increased the number of people who wrote to me - I actually got quite a few responses of "neat puzzle, not looking for a job, did I get it right?" And by virtue of not giving out an unencrypted email address, I didn't talk to anyone who couldn't code.
    - tptacek 15y ago
      A false negative in a job filter results in a phone screen with someone who can't do fizzbuzz. A false positive results in a candidate who can e.g. write a kernel memory allocator walking from your process because you're too much of a pain to deal with. Too many interviews, or losing the best possible candidates. I know which one I prefer --- especially because I know when I'm getting too many interviews, and can tune other things (most notably: where I post about jobs) to adjust that. I can't know who I'm losing as a result of my recruiting process being cumbersome.