8 ms·
ITA's old “Hiring Puzzles” is still a treasure trove of good problems
- headhunter 7y agoGood problems, yes. But effective interview tools? I thought we were moving away from arbitrary puzzles during technical assessments.
- orwin 7y agoI don't know. The wordplays, yes maybe, but the "build a chat" one is pretty interesting. What kind of buffer will you use, how do you handle errors, how did you test, which socket library did you use and why can tell a lot about how you work alone with clear but not well-defined objectives.
- 0x8BADF00D 7y agoChat is fine in scope and definitely achievable. But I’d rather whiteboard instead of doing these silly homework assignments.
- lonelappde 7y agoThese are "do on your time before you even request an interview", much less troublesome format than "in an interview".
- zschallz 7y agoEven more troublesome, IMO. This as a gate to interviews leads to a really uninclusive hiring process.
- LanceH 7y agoPlease state the alternative.
- tyri_kai_psomi 7y agoThe act of dissecting a candidate's qualifications and mapping them to what a company is searching for is always going to come off as appearing to be uninclusive to one group or another unless you are naive to believe every single human being contains the same skill set, current ability, and potential.
- kabdib 7y agoHow is this uninclusive? I'm not arguing, just want to understand your analysis.
- jpdaigle 7y agoAll of these seem to require a significant investment of time before the interview process gets kicked off, which is uninclusive because it biases the hiring process against candidates whose time outside of the office is consumed by taking care of their children. (Stereotypically, it’s borderline age-ism too because candidates in their 30s and 40s are much more likely to have children compared to people in their mid-twenties.)
- throwawaycanada 7y ago>All of these seem to require a significant investment of time before the interview process gets kicked off, which is uninclusive because it biases the hiring process against candidates whose time outside of the office is consumed by taking care of their children. You have to be kidding me. It also is biased against people whose time is spent playing video games or who do nothing at all. Some jobs are meant for people at a certain point in their career. Sometimes you don't get to have everything at the same time. People like you would argue it would be better to shut down hospitals than let doctors work long hours because those long hours might make women not want to do the job.
- ta29391 7y agoThe comment you've responded to is a fine example of "victimhood culture" as defined here: https://heterodoxacademy.org/seizing-means-knowledge-production/ https://heterodoxacademy.org/seizing-means-knowledge-product... HN feels weird tonight.
- deleted 7y ago[deleted]
- jodrellblank 7y agopeople who cannot spare the time are not the same group as people who choose recreation instead. Some jobs are meant for people at a certain point in their career. That should be determined by their employability, not the state of their personal life. People like you would argue No they wouldn’t; strawpeople don’t argue anything, they just fall over.
- zelly 7y ago> uninclusive Isn't that the point of a hiring process?
- maxerickson 7y agoIt depends on how you want to understand language. The point of a hiring process is to exclude candidates that are legitimately not suitable for the role. A reasonable contextual interpretation of the grandparent comment is that the hiring process will end up excluding suitable candidates for illegitimate reasons. Whether they should have to slavishly spell this out in a message board comment is a hot topic.
- TeMPOraL 7y agoThey should, because otherwise they're just virtue signalling, not making an argument.
- shawnps 7y agoITA used to advertise puzzles on the MBTA (public transit) in Boston and I emailed in a solution when I was a university student. Looking back, it seems like an effective way to find candidates with a sense of curiosity for problem solving. I eventually got an offer, but chose another job. They were acquired by Google soon after, and I sometimes regret not taking it!
- djinnandtonic 7y agoMost of these are 3 days of effort, well over what is reasonable to ask for in an interview.
- quartz 7y agoMaybe today when every company would love you to do a series of coding exams to vet you for their thousands of competing positions, but in 2007/2008 a fun brain teaser to chew on and solve in your spare time was novel, fun, and a good way to attract people who liked solving tough problems without just filtering through resumes.
- tgv 7y agoNot if you've worked on similar problems before, and you don't mind a slow solution (speeding up and keeping it correct is hard).
- baron_harkonnen 7y agoMost comments here are misunderstanding these puzzles as some awful alternative to leetcode, but as someone who remembers puzzling over these on the T, still learning to code, it was a very different world when ITA was using these. These appeared during the post-dotcom bust pre-startup boom period of 2004-2008. If you look at CS enrollment rates of the time you’ll see they were at record lows. Software paid well, but not that well and most engineering jobs were really bad ones resembling Dilbert comics. The culture of treating engineers well, giving them good tools, snacks, unlimited pto didn’t happen until later. At the time people solving hard problems and keeping up with changes in programming languages and tech were doing it because they loved it. Nearly everyone doing tech was doing it because they where obsessed and passionate about it. This is because if you weren’t there where much more pleasant ways to make about the same money. These ITA puzzles were a way of signaling “hey! we’re a company of people that love to code and work on hard puzzles too! If you’re the type of person that sees puzzles like this and can’t get it out of your head for the rest of the day, you should check us out!” These puzzles were not a leetcode like gates (in fact they very explicitly were NOT required for applicants), but rather a way of advertising to programmers that ITA was not just another boring big corp that would suck your passion for coding away.
- dmbaggett 7y agoAbsolutely right! While we did suggest that applicants try to solve one of these in whatever language they liked, the main purpose was to attract curious and smart people. And it worked! These puzzles brought us a ton of great candidates along with lots of smart people who weren’t looking for a job, but just wanted to know how their solution to a given problem stacked up. It wasn’t a proxy for 2019 whiteboard hazing; these were simpler times... -- Dave, ITA cofounder and creator of some of the puzzles, including my personal favorite, “Rebus”.
- timClicks 7y agoI'm looking at Rebus now and it looks tantalizingly difficult to work through. So simple, yet very subtle.
- quartz 7y agoI remember reading these on the T on my way to and from my first job in Boston back in maybe 2009. Back then it felt like you had to have a PhD to work at google and it was cool to know there were companies that just wanted curious people who liked solving puzzles with code. I don’t see the question I remember pondering, which was simpler than these but more fun to think through on a short subway commute— something like “Create the longest possible string of connected movie names, like ‘Independence Day of the Dead Man Walking...’” Edit: I found it! It was called “Sling Blade Runner” and it ran from 2007-2008 so my memory was off by a year. Solution: https://github.com/vy/ita-puzzles/blob/master/README.md#sling-blade-runner https://github.com/vy/ita-puzzles/blob/master/README.md#slin...
- rusabd 7y agoI just checked my gmail account - found that I had an interview with ITA Software in 2005. The task was about finding palindromes in the dictionary. Man, I bombed that one really hard. The language barrier was one thing, but lack of practice was another. Nowadays we get a lot of support from a plethora of sites, other engineers and many companies train people to take interviews which helps another way too. I got into a large Common Lisp project 5 years later anyway, so no bad feelings.
- mrspeaker 7y agoI think the key here is "old". It's their OLD hiring puzzles. They worked because they did them first, in a new an interesting way. So much stuff on the internet (and business in general) thinks that "hey, it worked for someone - it must be a new paradigm!" The people who wrote those puzzles would never think of writing them as incentives to join their company now - because that idea has long-since sailed. So much of the crap part of hiring (and business in general) is because it involves taking something unique and interesting that someone has done, and rehashing it until it's a hollow, shallow, uncreative version of its original effect!
- pmiller2 7y agoI find it interesting that 2 of the problems specify that solutions must be written in Java, but the others don’t require any specific language.
- ncmncm 7y agoThese problems were very late, mostly after ITA had got into developing an airline ticket-booking application that had to interact with badly managed airline companies who thought Java was actually a good idea. Extreme algorithm design skills were not so valued then, and a person who liked that kind of thing wouldn't enjoy interfacing with corporate servers.
- globba22 7y agoLike a few other commenters have mentioned, I had a great time trying to work through these problems having seen them in ads on the Red Line in the mid to late 2000s. For me, these puzzles were what got me to change careers; at that point I was in a non-technical job and didn't have any CS training. Still, I saw these puzzles and was hooked. Figuring out how to even set up a basic coding environment was part of the puzzle for me. I spent a few weeks on "Strawberry Fields", eventually getting to a brute force solution that passed all the tests. I was about to send it in, and happened to meet one of the ITA folks at a social event. After a few minutes of talking to this gentleman, I realized he was in a completely different intellectual class from me, and that I had to do a lot better than hacking together a solution to a single optimization problem if I really wanted to work in this industry. I persisted. I kept solving whatever coding problems I could find and rung by rung, climbed my way into some interesting and challenging software and data roles. I bombed plenty of whiteboard interviews along the way. It sounds funny to write down, but it is not an understatement to say that those ads on the T changed my life!
- ncmncm 7y agoI was hired at ITA in 2002 on the strength of solving one of their puzzles. The thing about the puzzles was that, once you start thinking about one, you want to see what a solution would look like, and the only way to find out is to solve it. Having solved it, you want to know how it compares to others'. So you send it off, even if you aren't really interested in moving cross-country. In my case, the puzzle was "add-a-gram": given a word list, find the longest sequence of words in which each word after the first is an anagram of the previous word, with one letter added. I thought about it for a day or two until I realized I had a workable strategy. Then I sat down at my laptop, checked the clock, and started coding. Exactly two hours later, I had a program that, after reading in the dictionary, was a one-page, deeply-nested loop that exited when it found the answer. It ran in ten seconds. How could I know if that was any good? I sent it off to ITA. The next day I got a call. We talked a little about setting up a phone screen, but she let slip that their solution was faster than mine. That could not stand. I spent the day inverting the control flow, with memoizing, and got a 10x speedup for less than 2x as much code, and sent that off. I went on to interview. At the interview, they assigned a programming task that was a simplified version of the puzzle. I worked there for three years, until I got fired for being depressed. (I found treatment five years later.) I don't remember much of it because I was sleep-deprived, from having toddlers who would only sleep in the daytime. But I encountered there the most intelligent people I have ever known. Most were musicians, on the side. I had been there three months before I thought to check their solution. My second version was faster. (Bitwise operations FTW!) While there, I encountered a problem that I have used in conducting dozens -- maybe over a hundred -- interviews: Undergraduates solve it in two minutes, graduates in five, MSs in 20 or more, PhDs either never, or as fast as an undergrad. Every single person who has solved it used the same hand gesture in describing the solution. Sometime later, ITA were bought up by Google, and I got some cash for stock. Taking care to owe only long-term capital gains did no good because Google paid cash, so we all ended up owing "alternative minimum" taxes as if we had made all the money in one day, not over N years. (The same thing happened when my next employer was bought by IBM.) Alternative minimum taxation is a terrible thing. The version of the puzzle I was assigned during the interview is one we sent to candidates between phone screen and scheduling an interview, at my next employer. If it ever took more than an hour from problem statement to solution, it was too long; although I heard of people taking 12+ hours. Some sent code that ran 12+ hours, and was wrong. (Our best ran in <1 ms, which no candidate matched.) Some candidates posted their solutions online, after being rejected, but every posted solution was really bad, so that was OK. Cheaters disqualified themselves. In 2010 I solved the "bitvector" problem in the posted article, during two weeks of sharply heightened intelligence I had while adjusting to the new antidepressant. To this day I marvel at that code. But by then, there was noplace to send it. Google took down the puzzles a little later. I sometimes wonder what Carl went on to do, after he left ITA.
- deepaksurti 7y agoI had put in a few hours of work to solve a few of these problems when ITA was not yet acquired. [0] - It was definitely fun working one's way to solve these - And they are nothing like the LC problems thrown around in interviews nowadays - Neither are these ITA problems a good fit for a 45 min interview from the duration perspective or getting `the right answer` perspective [0] https://www.deepaksurti.com/blog/category/ita https://www.deepaksurti.com/blog/category/ita edit: added the page link where I posted my solutions