I think this is a great problem to give someone, but the output you measure is the approach they take to it - are they methodical, logical, insightful, etc - no

I think this is a great problem to give someone, but the output you measure is the approach they take to it - are they methodical, logical, insightful, etc - not whether they solve it. Evaluating someone on the latter is indeed deeply incompetent.