Unless humans themselves were tested on a benchmark, the benchmark data doesn't help us compare the model to human performance. Of all the SWEs out there that

Unless humans themselves were tested on a benchmark, the benchmark data doesn't help us compare the model to human performance. Of all the SWEs out there that draw a salary, how many do you think would improve on this 14% unassisted figure?