2 ms·
Have there been many studies like this one that have been judged blind? I'd trust a study like this a little more if the human evaluators were presented with t
by simonw 3y ago
Have there been many studies like this one that have been judged blind?
I'd trust a study like this a little more if the human evaluators were presented with the output of GPT-4 mixed together with the output from human experts, such that they didn't know if the explanation they were evaluating came from a human or an LLM.
This would reduce the risk that participants in the study, consciously or subconsciously, marked down AI results because they knew them to be AI results.