When I was an indie game developer (distinct from a start-up in that I wasn't externally funded, though at the time we were quite profitable), I gave programmin

When I was an indie game developer (distinct from a start-up in that I wasn't externally funded, though at the time we were quite profitable), I gave programming tests that I could have passed with flying colors. If I remember correctly, I only had two people every really pass my test. One I hired and he worked with me for years and went on to be the VP of Engineering at a Fortune 500 company. One wanted $80/hour as a contractor and I couldn't afford to hire him. I did hire someone who had a positively mediocre performance (keep in mind most people failed outright, many answering NO questions correctly) on the test once, because I thought maybe my test was too hard. He washed out after a few weeks. What's my point? Don't set your bar too low, or you'll regret it. On the other hand, if you feel you need programmers better than you are, you may already be in trouble. If you need programmers at the same level but with different domain knowledge, that's not a problem, but it's hard to "look up" at a skill higher than you and be sure of what you're seeing. Even if you think you understand what the candidate is saying, it's hard to distinguish between someone smarter than you mapping out a realistic approach and a smooth-talker very effectively blowing smoke out of their nether regions.