2 ms·
Mechanical Turk suffers from coordinated fraud by people who want to be paid for doing a task without actually doing it [1]. The company I work for had to spend
by philipkglass 3y ago
Mechanical Turk suffers from coordinated fraud by people who want to be paid for doing a task without actually doing it [1]. The company I work for had to spend more engineering effort on building an internal reviewing-the-reviewers system to make it useful than we spent on the original Mechanical Turk integration. I'm not surprised that Amazon would avoid Mechanical Turk for higher consequence applications.
[1] e.g. https://timryan.web.unc.edu/2020/12/22/fraudulent-responses-on-amazon-mechanical-turk-a-fresh-cautionary-tale/ https://timryan.web.unc.edu/2020/12/22/fraudulent-responses-...
- ozim 3y agoIt will be fun to watch as AI tools flood mainstream. We already had a lawyer having case thrown out because he didn’t do the job properly and got hallucinations from LLM. Mostly because people don’t want to work.