4 ms·

Not only that, but whiteboarding very rarely tests for skills actually needed at the job. As you progress in your career, things like "I have held down the foll

Not only that, but whiteboarding very rarely tests for skills actually needed at the job. As you progress in your career, things like "I have held down the following software development jobs for X years...." are going to be far better ways to judge technical capabilities that are actually relevant to the job than 30-60 minutes of whiteboarding. Many many different industries have jobs that require technical skills -- not tech as in technolgy -- and they get away just fine with managing to hire people. Nurses need to be able to nurse, a highly technical skillset; no one is having nurses give fake shots on test dummies during interviews. They use credentials and experience, and accept the risk that a hire might not pan out. The fact that we want senior level developers to have to refresh/cram before interviews on how to implement graph search algs and hash tables just so they can pass some artificial whiteboarding section is a bit crazy. Their actual job experience over the past N years should be what counts. Now, conversations about how one would solve technical problems of a sort actually faced on the job are totally on point, and really should be a part of any job interview in any field. edit: Really, what we want as engineering types is for there to exist a way to gauge ability in a purely objective way. But there isn't one; it doesn't exist. Furthermore, you are building a team of people. IMO the focus should really be on fit and soft skills regardless. Make sure they meet a minimum bar of technical ability, then work to verify whether they'll be a productive, beneficial teammate.

sokoloff 5y ago
Credentialing for software engineers (such as licensing and continuing education for nurses) has its own set of problems, both in terms of gate-keeping but more importantly in the type of work being entirely different. There’s a spread in performance from the +1σ to the -1σ nurse, but both will be functional in a nursing role, so checking credentials is a mostly sufficient evaluation of occupational ability. The spread in software ability is so much larger that the -1σ candidates (the least-effective ~15% of people who have ever worked in computer programming jobs) are worth trying to select against in a way the least effective ~15% of nurses probably are not. (I’m not in medicine so I’m not sure; apologies if the same effect is at play there as well.)
- dragonwriter 5y ago
  > The spread in software ability is so much larger that the -1σ candidates (the least-effective ~15% of people who have ever worked in computer programming jobs) are worth trying to select against in a way the least effective ~15% of nurses probably are not. This isn’t an argument against credentialling since it is literally the direct effect of not having credentialling in software. Credentialing cuts most-to-all of what would be the low tail of the profession off before it ever enters. Nurses and lawyers who can’t do their profession’s equivalent of fizzbuzz mostly wash out of the exams to enter the profession (or earlier), they don’t show up in job interviews, except where the inability is produced by some kind of post-entry decline in capacity. And even then, decertification is a real possibility, which further purges the low end of the distribution. So, yeah, a -1σ software developer (or at least software developer job applicant) is worse compared to basic expectations than a -1σ nurse, because a nurse as below expectations as a -1σ software developer is would be compelled to find a different profession because of credentialling requirements.
  - sokoloff 5y ago
    You make a good point about an idealized credentialing mechanism cutting off the left tail of the distribution, but the spread in performance will still be much higher in credential-holding SWE than nursing and, because of the high leverage, still worth selecting for. You can only be so much better at nursing than the average qualified nurse. How many more patients will the best nurse save? You can be several multiples (whether it’s 10 or not, I won’t get into here, but I think it’s at least 3) more effective than the average in SWE.
    - dragonwriter 5y ago
      > You can only be so much better at nursing than the average qualified nurse I...disagree rather strongly that this, to the extent it is true, differentiates SWE from nursing. Comparing workers with identical responsibilities, the same is true in SWE, in both cases there are large impact multiples possible within the field, but they come from roles with greater responsibility; in nursing, because different roles require different credentials, this is reflected in the fact that a more competent nurse will be more likely to take on a more responsible role within the same credentialed category, and also be more likely to acquire greater credentials over time compared to a less competent nurse. “Nursing” isn’t a binary credential, but a whole set, starting with a basically heirarchical set: CNA -> LVN/LPN -> RN and beyond that various Advanced Practice Nursing credentials. SWEs likewise have wide variety of scopes of practice and responsibility, but because we have no structure in the profession, they are assigned ad hoc and even with common titles there isn’t consistency in substantive roles, skills, or qualification. But, again, that’s a product of the absence of structure and credentialling, not an argument for it.

sokoloff 5y ago

Credentialing for software engineers (such as licensing and continuing education for nurses) has its own set of problems, both in terms of gate-keeping but more importantly in the type of work being entirely different. There’s a spread in performance from the +1σ to the -1σ nurse, but both will be functional in a nursing role, so checking credentials is a mostly sufficient evaluation of occupational ability. The spread in software ability is so much larger that the -1σ candidates (the least-effective ~15% of people who have ever worked in computer programming jobs) are worth trying to select against in a way the least effective ~15% of nurses probably are not. (I’m not in medicine so I’m not sure; apologies if the same effect is at play there as well.)

dragonwriter 5y ago
> The spread in software ability is so much larger that the -1σ candidates (the least-effective ~15% of people who have ever worked in computer programming jobs) are worth trying to select against in a way the least effective ~15% of nurses probably are not. This isn’t an argument against credentialling since it is literally the direct effect of not having credentialling in software. Credentialing cuts most-to-all of what would be the low tail of the profession off before it ever enters. Nurses and lawyers who can’t do their profession’s equivalent of fizzbuzz mostly wash out of the exams to enter the profession (or earlier), they don’t show up in job interviews, except where the inability is produced by some kind of post-entry decline in capacity. And even then, decertification is a real possibility, which further purges the low end of the distribution. So, yeah, a -1σ software developer (or at least software developer job applicant) is worse compared to basic expectations than a -1σ nurse, because a nurse as below expectations as a -1σ software developer is would be compelled to find a different profession because of credentialling requirements.
- sokoloff 5y ago
  You make a good point about an idealized credentialing mechanism cutting off the left tail of the distribution, but the spread in performance will still be much higher in credential-holding SWE than nursing and, because of the high leverage, still worth selecting for. You can only be so much better at nursing than the average qualified nurse. How many more patients will the best nurse save? You can be several multiples (whether it’s 10 or not, I won’t get into here, but I think it’s at least 3) more effective than the average in SWE.
  - dragonwriter 5y ago
    > You can only be so much better at nursing than the average qualified nurse I...disagree rather strongly that this, to the extent it is true, differentiates SWE from nursing. Comparing workers with identical responsibilities, the same is true in SWE, in both cases there are large impact multiples possible within the field, but they come from roles with greater responsibility; in nursing, because different roles require different credentials, this is reflected in the fact that a more competent nurse will be more likely to take on a more responsible role within the same credentialed category, and also be more likely to acquire greater credentials over time compared to a less competent nurse. “Nursing” isn’t a binary credential, but a whole set, starting with a basically heirarchical set: CNA -> LVN/LPN -> RN and beyond that various Advanced Practice Nursing credentials. SWEs likewise have wide variety of scopes of practice and responsibility, but because we have no structure in the profession, they are assigned ad hoc and even with common titles there isn’t consistency in substantive roles, skills, or qualification. But, again, that’s a product of the absence of structure and credentialling, not an argument for it.