I think it's objective because I can weed out candidates based solely on objective questions about their solution to the coding problem. Of course there's still

I think it's objective because I can weed out candidates based solely on objective questions about their solution to the coding problem. Of course there's still lots of subjectivity in the process, but I did say “the merest hint of objectivity”. Here's my real world case study. I wrote a programming problem for RGM Advisors. The company was sold and so its web site no longer exists. Here's someone's solution to that problem: https://github.com/perrye2/LimitOrderBook https://github.com/perrye2/LimitOrderBook My original problem statement is in the PDF in that repo. Here are some of the objective ways we evaluated submissions: - Does the submission parse/compile? - Does the submission run and not crash? - Does the submission follow the specification for how it should be invoked? - Does the submission produce the correct output? - Did the candidate submit answers to the time/space complexity questions given in the problem statement? - Do those answers correctly characterize the submission?