3 ms·
sort of surprised it wasn't just using their Mechanical Turk site
by RankingMember 3y ago
sort of surprised it wasn't just using their Mechanical Turk site
- philipkglass 3y agoMechanical Turk suffers from coordinated fraud by people who want to be paid for doing a task without actually doing it [1]. The company I work for had to spend more engineering effort on building an internal reviewing-the-reviewers system to make it useful than we spent on the original Mechanical Turk integration. I'm not surprised that Amazon would avoid Mechanical Turk for higher consequence applications. [1] e.g. https://timryan.web.unc.edu/2020/12/22/fraudulent-responses-on-amazon-mechanical-turk-a-fresh-cautionary-tale/ https://timryan.web.unc.edu/2020/12/22/fraudulent-responses-...
- ozim 3y agoIt will be fun to watch as AI tools flood mainstream. We already had a lawyer having case thrown out because he didn’t do the job properly and got hallucinations from LLM. Mostly because people don’t want to work.