7 ms·
Seems good, I like the choice. In discussions on this topic I see a lot of: "Programming on the spot is hard, let people program at home"! But then other peo
by brianwawok 11y ago
Seems good, I like the choice.
In discussions on this topic I see a lot of: "Programming on the spot is hard, let people program at home"! But then other people say "Why should I program for free at home, my resume clearly shows I am already a skilled programmer. All this will do is cater to young people without families, or those fresh out of school".
I am not looking to hire devs right now, but I am thinking about the same idea with a tiny tweak when we move to that stage. If the verbal interview goes well, offer 2 choices. Make it clear neither choice is seen as the better choice, and both will be judged equally.
* Sit on a computer with me for an hour, and show me how to code a fairly simple program.
or
* Get a small actual work assignment to take home and code. Would expect it to take maybe 5 hours to code. Offer $500 as a 1099 contractor to complete the assignment within the next 2 weeks or so.
This gives both groups a chance. The too busy to do a big programming assignments can code in front of me for an hour. I should be able to judge their chops pretty fast. For the people more nervous to code in front of me, they can get paid a nominal fee to code some small piece of code.
The only group I exclude is the group that doesn't feel the need to show code to land a job, but not too interested in that group. I have seen too many good talkers and bad coders to want to risk this group.
- bjones22 11y agoIts good in theory, but it leaves a lot of ambiguity for the interviewee to parse through. For instance, if given a two week window would it look better for me to do it tonight? Would it show ambition? Or would it seem like I'm desperate, and lead to a lower amount of compensation being offered to me? Should I spend far longer then five hours on the assignment, and turn in superior work while making it seem like I only spent 5 hours? What is my competition doing? As someone who's recently been through the ringer, including one six hour take-home, all I want is a clear demonstration of respect and rationality. Bring me into your professional office. Let's talk like professionals. Allow me to demonstrate my professional skills. Call me back with a professional yes or a professional no, all within a professional time frame. That's it. Remote or otherwise less traditional assignments / roles / jobs will deserve and benefit from their own process. But how we strayed from the straight forward formula is beyond me, my guess it was an initiative started by a handful of companies who had trouble hiring. I don't think hiring devs is the systematic issue everyone makes it out to be. Assessing talent is always hard, be it an artist's, an athlete's or a programmers. I think rather then assume the cost of the investment in hiring, companies chose to blame the system and that's where this absurd roller coaster started.
- totalrobe 11y agoGood points. If you really care about being impartial, maybe have the 2 week period and a blind submission method in which the interviewer does not see when the assignment was completed.
- bjones22 11y agoBut my rent is due the Friday after next and I need to know if I should send out another wave of resumes. It isn't but it strikes me we are looking very hard to find a new way to do things, when the old way was pretty damn good. Sit me down and talk about technology for ~thirty minutes. If I don't have the social skills to successfully do this (minority issue) I likely would not be able to communicate well with a team and thus should not be a candidate anyways. You will then know immediately whether you want to hire me (or progress me to another round) or not. I then get a call two days later and can progress with my life. People pretend like all this hiring strategy is for the good of the candidate. It's not. As with everything else its for the good of the company and its investors. Here's a thought: Invest in a competent hiring manager who can see through applicant bull shit and identify talent within a reasonable range. Includes basic negotiation skills. And assume the rightful risk that is employing another human being.
- lordnacho 11y ago>Invest in a competent hiring manager who can see through applicant bull shit and identify talent within a reasonable range. Includes basic negotiation skills. And assume the rightful risk that is employing another human being. Problem with that is it's hard to find one. It's gotta be someone with pretty good coding skills. This person would then have to share their time between either coding head-down or managing coders, either of which are time-consuming and intolerant of disruption. One idea I had was you could have mutual feedback. A bunch of people would after a while have anonymous input on each other, giving you say 10 coder's impressions of a fellow coder. This wouldn't have to be quizzes, half hour coffees could do.
- dpark 11y ago> Sit me down and talk about technology for ~thirty minutes. This is an efficient way to hire a team of good bullshitters. I've interviewed people who did extremely well when we were "talking like professionals" but were unable to do even very simple coding problems. My bar for coding is really not that high. I don't expect perfect syntax. I don't pick the language. I don't expect "the one answer". I expect people to write code that could work after syntax and small bugs are fixed, and most critically, I expect people to be able to discuss their code meaningfully. Unfortunately, "ability to write basic code" and "ability to talk like professionals" are not tightly correlated. And I expect both of these things from dev candidates.
- TranquilMarmot 11y agoI recently graduated from college and started looking for my first programming jobs. I ran into a ton of these "take home" interviews and they were some of the most stressful things I've ever done. The first one, they asked me to solve an incredibly complex math problem that I had no idea about so I struggled with it for 5 or so hours before giving up. Probably good that they didn't give me the job; if they were expecting me to know the level of math they were requesting then I would have had a pretty bad time. So I guess the test worked in that regard. The second one interview at a different company, they gave me more moderate questions after a phone interview- mostly questions testing knowledge of a specific language. When I asked how long it would take, I was told "you have a deadline of 8 hours from when you download the zip file to when you turn in your code, expect it to take the entire 8 hours". That was probably the most stressful 8 hours of my life, way worse than any whtieboard interview would have been. I didn't look away from my computer once the whole time, did not let myself get up to eat, go to the bathroom, or anything. My girlfriend was in the room and tried to console me while I was doing it and stressing out and I ended up yelling at her to be quiet because I was trying to hard to concentrate. I finished the last problem about 10 minutes before the deadline, zipped the files up, and sent it to them. I never heard back. Favorite interview I've ever had was a combo of a live coding session and a phone interview. They used an online tool that they gave me a link to that had syntax highlighting. The interviewer on the phone could see where I was typing and could highlight stuff etc. Think google docs, but for coding. They asked me to write some algorithms, then asked me to re-write them recursively, then asked a bunch of questions about the limitations of the algorithm, cases when it would be used, etc. It was fun, not stressful in any way, and the interviewer even taught me some things along the way! I feel like they got a really good picture of my thought processes and my personality so they could accurately judge if I would be a good fit on the team. Paying somebody to do the take-home coding assignment and paying them would definitely help alleviate some of the stress, but I'm still not a fan of the format. You don't know how long it took the person to make their solutions, and you don't get a good idea for how they work, only what they can do (both are equally important, in my opinion).
- ammon 11y agoThose sound like really bad take-home questions. I hope that better questions will improve the experience
- twright0 11y ago> Offer $500 as a 1099 contractor to complete the assignment within the next 2 weeks or so. Just as an aside, I would actually be more willing to undertake this type of interview if you weren't paying me. I don't have any ethical qualms about interviewing while working a full-time engineering job, but I'm not entirely comfortable taking a contracting job under the table. It may be something of a symbolic gesture given that it's such a small time investment and small amount of money, but it feels fundamentally dishonest, especially if you're a current or plausible future competitor to the company I currently work at. The official policy where I currently work is that moonlighting is allowed but must be approved by our legal team, and while I could probably get away with not asking for permission, I'd be pretty uncomfortable in both cases (asking, or not asking).
- istorical 11y agoMy guess is an applicant that stated the above would be allowed to work for free :)
- bbcbasic 11y agoInteresting and very ethical. Opposite of me. I don't see that a company should own your soul when you work for them. So doing a small amount of work for effectively beer money in your spare time is no problem. Even taking a second job is OK if it doesn't affect your first one.
- facetube 11y agoBlanket prohibitions on moonlighting are illegal in California AFAICT, unless it's framed as a conflict-of-interest avoidance issue. See http://codes.lp.findlaw.com/cacode/LAB/1/d1/4/s96 http://codes.lp.findlaw.com/cacode/LAB/1/d1/4/s96, section (k).
- codingdave 11y agoJust FYI, "under the table" means getting paid without proper documentation or withholding of taxes, FICA, etc. Doesn't really apply to 1099 situations.
- danieltillett 11y ago
- bsder 11y ago> Would expect it to take maybe 5 hours to code. So, if you are interviewing at 20 companies, you need to expend 100+ hours or almost 3 full work weeks? It should take 1 hour or less. Period. Probably less that 1/2 hour. I doubt I get much more information asking you for a 5 hour assignment than a 1/2 hour assignment. If I'm really that interested in your programming on the fly, I should do it at the interview where I'm paying for your lodging, food, etc. I should tell you what you are going to be doing, and to bring your laptop set up to do that.
- burntsushi 11y agoIf you're interviewing with 20 companies, you're probably already spending 4+ hours with each of them in person. That's a lot of companies to entertain! When I was interviewing, I could barely maintain the composure to interview with 3 companies! (Only one of which had a take-home assignment.)
- brianwawok 11y ago> So, if you are interviewing at 20 companies, you need to expend 100+ hours or almost 3 full work weeks? I have never interviewed at 20 companies when I needed a new position. If you do, cool - but not sure I want to simplify my hiring process to help someone mass interviewing. If we have a conversation and we both like each other, let's see if we can come to terms we are both happy with. If we are playing other companies off each other for 1k raises, it seems not really worth the hassle.
- x0x0 11y agoI like the idea of getting paid $500 or even $1k for a take home test. It's frankly a simple matter of respect. For employers, they're just asking you to do one task, but for employees, talking to 4-6 companies in an interview cycle can easily be 40 hours of interviewing and another 40 hours of work on top of that. I'm at a point in my career where I mostly refuse take home tests because I'm busy and I value my free time. Getting paid would make me much more willing to jump through hoops. Particularly when that day of vacation cost me $350 after taxes, so it's not like I don't have skin in the game already.
- brianwawok 11y agoThis was my thought as well, take home tests are a good test of your skills, but super annoying when you already have a job + family + hobbies.
- imh 11y ago>"Why should I program for free at home, my resume clearly shows I am already a skilled programmer. All this will do is cater to young people without families, or those fresh out of school". I share this opinion, but only for certain ways of doing it. If it's done in a fully automated way, before even having a phone screen, then it's too easy to waste my time. As an alternative to the whiteboarding interview, however, it could be great.
- alain94040 11y ago> Offer $500 as a 1099 contractor to complete the assignment within the next 2 weeks or so. I like this, not for the money, but because it guarantees that the company is not giving this assignment to 100 different candidates ($500 x 100 is getting prohibitive for a hiring budget). I'm more willing to put the effort if I know I'm one of the "finalists" for the position.
- SomeCallMeTim 11y agoAgreed that it's a positive thing to actually pay people for nontrivial amounts of work. Downside is that, as a company paying someone to accomplish a task, I'd want to give a different task to each applicant, so that if they do a good job, it provides value to the company. And this is a problem because rarely are two programming problems exactly as difficult as each other, so the test isn't normalized. Interviewing is hard enough when you keep all the variables that you can control the same.
- sokoloff 11y agoMake the number $250 and give everyone the same problem (which you have to change every so often because of glassdoor and the like). That's less than you're already spending on salary for the interview slate, so you're at most doubling your already small costs for a critically important function for your company.
- rue 11y agoThe value to the company is making a good hire.
- brianwawok 11y agoI mean, a bad hire is going to cost me thousands of dollars - if not tens of thousands of dollars. $500 is pretty cheap to figure that out up front on a candidate I am otherwise ready to hire. I am not going to do this to 100 people and pick the best, I am going to do it for someone that in every other way is a good to hire dev. I don't think I would give out the same work to multiple people, let them put it into production on their first day and get the pride going ;)
- Bahamut 11y ago$500 is too low - good developers will often charge $200+/hour freelancing, there is little incentive for them to deal with a take home test for that price with all of the time & stress that come with take home tests. A choice is better than no choice though, but too many companies fumble through handling take home tests to make it worthwhile to a quality developer with any sense of value.
- viraptor 11y agoYes, they charge $200+/h - when they actually do the work. This is my pet peeve lately when I see people throwing that number around. You're not actually working 24h. You likely don't work on the weekends. You take time to organise new work in between. Neither of the breaks are actually paid. You get paid that much as a freelancer when you produce value for the company. So by doing an extra assignment, especially one that is a useless piece of code, no - $200/h is ridiculously high price.
- Bahamut 11y agoBut when comparing the difference, and considering a code project for an interview has a tendency to be even more stressful, which would a person rather spend their time on? It certainly is not the code project - I have heard & experienced too many stories where companies vastly underallocate time, or not respect that job seekers have other things that keep them busy typically, including less bureaucracy/time wasting (especially if a candidate has significant open source contributions), or not looking at the project, or even rejecting candidates for non-code related reasons (happened to someone I know today). I'd much rather freelance for that type of stress & when having to compare the economics time-wise, which a take home test simply does not match - that is the whole point. If a company does not want to pay that much, maybe they should respect the prospective employee's time, especially since it is a job seeker's market.
- AdieuToLogic 11y ago> Yes, they charge $200+/h - when they actually do the work. Agreed. Annual billable hours for consultants, be they developers, management, lawyers, et al, are considered huge if near 1500. That roughly works out to just under 30 billable hours per work week when vacations/holidays and non-billable time are taken into account. As you surmise, just because someone _can_ bill X/hour doesn't mean that each hour they breathe commands the same remuneration.
- sokoloff 11y ago> But then other people say "Why should I program for free at home, my resume clearly shows I am already a skilled programmer. Yes, and if I copy that resume and put my 6 year old's name on it, then her resume clearly shows she is a skilled programmer.