The problem is that adjusting the base selects for two kinds of people: 1. People who have come across that trick before. 2. People who have a lightbulb momen

The problem is that adjusting the base selects for two kinds of people: 1. People who have come across that trick before. 2. People who have a lightbulb moment in the 45 minutes of the interview. Now, given that someone has passed the test, what is the probability that it is because of 1 or 2? The VAST majority who pass the test will fall into category 1. The test manages to have both low sensitivity and low specificity. Well done! Most likely, the interviewers are completely unaware that the solution is only obvious to their uncurious minds because someone else told them the answer. They don’t appear to have an understanding of where quantum-leap ideas come from, or how to foster them.