Given the low quality results of the humans, I suspect they were paying too low and the workers were giving low quality answers. I wonder if they should have pa

Given the low quality results of the humans, I suspect they were paying too low and the workers were giving low quality answers. I wonder if they should have paid more per task to get a better comparison. It doesn't feel surprising that GPT is cheaper and more accurate than a human who is randomly clicking buttons. Custom software can already do that.