9 ms·
Not only coders are hard to recruit
- alexgotoi 10y agoFeel free to ask anything or provide feedback. Thanks
- globalgobble 10y agoI am not sure you can do this I believe sysadmin/sre/devops person wears too many hats. What are you going to test ?
- johnny_snq 10y agoWe are going to give real life scenarios based on the various roles you are testing with.(basicly a ssh login to the test machine) And we plan to asses the candidates way of solving the problems based on what commands and what process it uses to identify and solve the problem.
- globalgobble 10y agoPlease allow me my honesty but that's a stupid way of thinking about candidates and the roles. Or I do not get it. So you are basically going to judge the candidate based on what criteria ? If they use vi instead of cat to append to a file ? So decide what is the best way of solving the problem ? Or you give +1pt for using tail instead of opening the whole file in VI ? Are you aware of the fact that there are many types of systems and products that sysadmins use ? They do not behave the same. It makes no sense to use "top" on Solaris even the number for "uptime" reported by Solaris are different. What about Windows sysadmins ? What about stuff like Veritas ? What about docker ?
- languagewars 10y agoWhen I used to work in OS support my actions were optimized for the assumptions of a default minimal install and being able to describe actions to a person of questionable knowledge over the phone and interpret what they would most likely try to read back at me. The certifications were along those lines too.. While the exact nature of the certifications was ridiculous and would be even more ridiculous in terms of judging a general user's skills, dropping an administrator on minimal installs with broken ttys, etc makes a lot of sense. If you can't recover a system when vi is not an option then you have a problem, if you spend a lot of time recovering a good term when you could have used tail, then you are also not ideal. The only suggestion I would make is that a good tool is present and working then I don't expect a penalty. I expect tools to not be present accordance with standard minimalist setups and to pay extreme penalties if I need to call a package manager or move to a less minimalist install to complete the task.
- globalgobble 10y agoI strongly disagree. We should not test edge cases and specific scenarios. We are trying to test the candidate and his abilities in daily tasks. If I say I use vi instead of "commands" I will probably solve most of the "text" editing tasks faster than an admin that only knows how to get around using commands. I can come up with tons of scenarios when where you do not really know the internals you can get stuck easily. Like if I do chmod -x on the chmod binary. Does it prove anything if the candidate is not able to solve such task ?
- CmdrSprinkles 10y agoWhile I mostly agree with you, I can speak from experience with how we handled the first point: We were interviewing a new admin for the sysadmin/maintenance team and her answers to "how would you solve this problem?" were "Open that file and check that these variables are set and, if not, set them". One of the more jerkish people there went down the rabbit hole of "How are you going to edit that file? What if you don't have vim? Okay, what if you don't have emacs? Nano is gone too" leading to the response that made us hire her: "Well, in that case the system is probably completely hosed and we need to stop configuring things and focus on recovery. But I think you are looking for me to tell you a sequence of commands that involve cat. If you give me five minutes I can check stack overflow and get back to you with those" Which I personally think should be the response for stuff like that. Understand there is an alternative and a way to resolve the corner cases and know how to get that info if needed.
- johnny_snq 10y agoWe are aware that there are more ways to skin a cat. I think it's fair to evaluate a candidate based on wether if he can solve an issue or not and the amount of time it took. I agree it would be stupid to score based on individual commands and we didn't plan to go that low level. But we plan to count the number of commands with typos or wrong parameters. Don't you agree this would be a way to differentiate between 2 people that solved the same problems in the same amount of time?
- globalgobble 10y agoSorry I have to disagree here as well. I do not think the time or number of commands or typos should be measured. I do not think you can do any quantification here. I believe a lot of sysadmins (talking about unix) do w;uptime;inspect syslog as soon as they connect to the system. Most of the time it's just not necessary to do this but for a lot of sysadmins it's a habit that actually saved their asses several times. Does it make sense for a sysadmin to know a numeric notation for chmod ? Probably. Would I ask that on an interview ? Nope If you need to ask why then you have probably never worked in a heterogeneous environment.
- throwawayosiu1 10y ago1. How exactly are the sysadmins graded? (because in the end, let's be real...this tool will most probably be used by HR folks to filter out candidates and they'd not care too much if you send over a screencast/replay of what the candidate did) 1.1) Sys admins generally have their own set of tools (which would be customized per company I guess)...would these be installed by default? (I'm assuming you are provisioning docker containers / candidate / test and then destroying them after use). 1.2) I've used the ones that are sent for developers and it's been a pretty terrible experience at best (it's buggy, won't accept valid code etc.). If this is the case for sysadmins, it's even more worse (but then again, I guess you can put a spin on it and claim it's for the best as they'd have to deal with unpredictiability). 2. How will different technologies be integrated to test candidates on? (for example, testing knowledge on multi node kubernetes cluster and so on).
- johnny_snq 10y ago1. I'm thinking the best grading sistem would be yes / no ? rigth ? If you manage to solve the problem and tests pass you pass. 1.1 If you get root access on a machine you have the freedom to add whatever tools you feel fine. 1.2 I don't think doing a terminal emulation is the way to go. 2. Advanced tests are on our plans but we haven't got everything figured out yet.
- hopster 10y agoWhen will be the beta version available to test?
- alexgotoi 10y agoWe proposed to have it available on mid December. Subscribe on www.sysadminsarena.com and we will keep you up to date.
- pmoriarty 10y agoThere's been a lot of criticism of hackerrank.[1][2] Are you doing anything to make sure your service gets more respect? [1] - https://news.ycombinator.com/item?id=12825953 https://news.ycombinator.com/item?id=12825953 [2] - https://news.ycombinator.com/item?id=12667174&source=techstories.org https://news.ycombinator.com/item?id=12667174&source=techsto...
- arenaninja 10y agoI don't think I would enjoy HackerRank as an interview, but as a user I do enjoy being able to practice computer science problems.
- alexgotoi 10y agoJust wrote an answer above which i think is good for your concerns. What'do you think?
- sundvor 10y ago(Speaking as a coder here, although I've also done sysadmin through most of my 20 years of working in the industry). This would be quite nice. Going through the job searching process at the moment, the "aptitude tests" etc that I've seen are very good at blowing cobwebs off my obscure analytical skills, which I rarely if ever use, yet fail completely at getting any gauge of my ability to get every day stuff done in a clean, smell-free way. As a result I'm now doing kata training on Coderwars and am getting more used to this style of testing. It's actually good fun, and I think it'll help increasing my ability to just spit out code. In real life scenarios though, most of the time is spent analysing a problem or process flow.
- alexgotoi 10y agoYou just mentioned some of reasons why we are making this product. If you have more ideas, please share with us. Thanks
- arenaninja 10y ago
- davidgerard 10y agoSo this is to have a test VM they have to fix? Excellent! I heartily approve of this method for finding a sysadmin. This is a thread where I talk about how we did this: https://news.ycombinator.com/item?id=8332104 https://news.ycombinator.com/item?id=8332104 We used to use it a lot - a trivial Java webapp running in a slightly misconfigured Tomcat with a slightly misconfigured Apache in front on a slightly misconfigured Unix box - though it's fallen by the wayside because we never quite get around to the faff of setting up a slightly broken test system for them. So having that as a service would be pretty good. If this is what you're doing: I suggest not just keystrokes, but that they keep a log of what they're doing and thinking. Because we never expect them to fix everything wrong with the box, but we do want to know how they approach it.
- alexgotoi 10y agoHi David, thanks for your thoughts. Very useful the thread provided. And YES, this is what we are doing. Keystrokes is just one of the metrics we are about to collect and analyze. We are also thinking about number of commands wrote, how many were correct, how many wrong, also a log of the entire test. In future phases, we may take into consideration pair working or capturing a movie of the test. What other ideas of relevant metrics do you have?
- lisivka 10y agoSo, if I will follow best practices and will prepare backup, then restore backup locally (to check that backup is OK), then will play with backup until problem will be solved (to not harm target server), then prepare runbook, and then will just execute it at target server, I will pass your test? Just two commands.
- johnny_snq 10y agoYes. you should pass the test. This is one of the scenarios we are thinking. you get the backup location do the restore. done you passed.
- 10y ago
- otoburb 10y agoThe Cisco Certified Internetwork Engineer (CCIE) certification used to be the gold standard amongst network engineers 10-20 years ago. Becoming a CCIE required a passing a notoriously difficult hands-on 8 hour in-person lab examination[1]. SysAdminsArena reminds me of a remote version of the CCIE Lab Exam for sysadmins. Fun fact: the CCIE program was established in 1992 and was originally going to be called "Cisco Top Gun"[2], but they had to choose a more serious name. [1] https://learningnetwork.cisco.com/community/certifications/ccie_routing_switching/lab_exam_v5 https://learningnetwork.cisco.com/community/certifications/c... [2] http://www.bradreese.com/blog/how-the-cisco-ccie-program-was-born.htm http://www.bradreese.com/blog/how-the-cisco-ccie-program-was...
- alexgotoi 10y ago20 years later -> SysAdmins Top Gun :))
- Peroni 10y agoThe premise that technical people with in-demand skills are hard to recruit has very little to do with the screening process. The screening process is not a difficult problem to solve. The real difficulty in recruiting in this space is finding and engaging these people, not testing them. If this is a Hacker Rank for sysadmins, then great. I'm sure you'll have plenty of users but we're still a long way away from solving the bigger problem.
- zzzcpan 10y ago> The real difficulty in recruiting in this space is finding and engaging these people, not testing them. Tons of people in this space hang out on various places online, where you can simply advertise or do some PR and many do, is it really that difficult?
- Peroni 10y agoWhen was the last time you engaged with a company with a view to working with them because you saw an ad they happened to post in the right fora?
- deleted 10y ago[deleted]
- ohyoutravel 10y agoThe monthly hacker news "who is hiring" thread.
- Peroni 10y agoGreat example. HN is the perfect place to find people right? I mean, I should know. HN who's hiring, like most online job advertising, is a crapshoot. It's a once-a-month post where you are drowning in noise. Finding a very large group of potentially relevant people for the roles you are hiring for isn't as straightforward as it sounds. Engaging said group and convincing folk from said group to come work for you is exponentially more difficult.
- devonkim 10y agoInteresting problem you're addressing but I've been working on this problem from a completely different set of metrics. Fundamentally, I really don't care how a problem is fixed as long as it doesn't have bad repercussions. If a web server is "slow" users don't care why - giving freedom to admins to approach higher level problems while still measuring them is something I'm confident that can be done while I take a number of issues with assessing anything based upon commands entered even in realtime (I'm mostly concerned from a security / bad or illegal practices in prod perspective, to be frank). The approach I'm working on is easier to do technically but requires some more costs. With that said, glad to see I'm not the only one that's been frustrated with hiring devops / sysadmin / SRE roles. Google's even commented how hard hiring for SREs is for them and I think we have a huge gap between people stuck in the 90s approaching systems and those that modernized.
- alexgotoi 10y agoWe are also glad that there are other people that are working on this issue. Good luck!
- deleted 10y ago[deleted]
- freddref 10y agoIsn't everyone hard to recruit? The difference in perception of coders might be that the evidence for a bad recruit is obvious in the code they produce. There could be many bad recruits in all other areas but are less obvious. I generally like the idea of clearer quantification of a persons output but it should be done very delicately. As in, if you are going to measure everything someone produces, maybe that data should only be available to that person and it's up to them how they share it. The uncertainty principle likely applies to people too. Hard to measure people without influencing them. Trick is to do it in a positive way. Managers measuring people for the purpose of firing them would be perceived, and have a negative effect on morale, than measuring people to identify opportunities for education, training or skills development.
- alexgotoi 10y agoGreat idea to offer the data to the one that is producing it and he/she decides what to share. Thanks
- kesor 10y agoWhen you have a very low supply of high quality people, and at the same time a huge demand for those same people, it is a major problem. You claim to solve this problem, by making it even harder? How does that help?
- alexgotoi 10y agoKesor, we do not claim to solve this problem. We propose a product to help assessing easier the technical skills, not to improve the sourcing. In the recruitment process flow, our product comes after there is a short list of candidates (screened based on their resume) and want to perform a more deep screening. We know there is the gap mentioned by you. Hopefully, in the future, we will be able to provide help in this area too.
- tristor 10y agoSpeaking of sysadmins, a note for yours. You are currently serving blog.sysadminsarena.com over HTTPS with an HTTP to HTTPS redirect, but are not doing the same for your website. In fact, you don't have an HTTPS endpoint for your website at all. Going to your website by modifying the URL from the blog entry (because clicking your logo takes you to the front page of the blog, not the website) results in a `ERR_CONNECTION_REFUSED`. Just an FYI :)
- alexgotoi 10y agoThank you!
- johnny_snq 10y agoI'll fix it tonight after work with LetsEncrypt most probably. The blog is hosted on medium.com so they provided the ssl termination. But there should be no excuse for not having https on a website in 2016.
- xiphias 10y agoNow this looks like a real interview task, not installing apache (which I as a non-sysadmon could do easily as well)