> collaborating on a problem with the interviewee That's not how developers spend the vast majority of their time. It's a poor signal in my experience. What it

> collaborating on a problem with the interviewee That's not how developers spend the vast majority of their time. It's a poor signal in my experience. What it selects for is candidates who are immediately comfortable collaborating in real time with someone they have never met. That doesn't mean you aren't getting good candidates. What is means is that I spend far less than you finding good candidates because I also hire people who are great developers and who would fail at your interview.