3 ms·
This study is useless, the experiment design is so fundamentally flawed that it provides virtually no real information. As others have pointed out, mturk alway
by flaminHotSpeedo 3y ago
This study is useless, the experiment design is so fundamentally flawed that it provides virtually no real information.
As others have pointed out, mturk always had workers using automation, and the researchers set up a task that is an obvious application for LLM's, who's output makes it difficult to different humans generated output, and isn't even a good use case for mturk (since the output is free form text that would have to be validated by humans rather than an automated quorum check).
This is simply an insult to science