3 ms·
Because you're forgetting the other side of the equation, what sort of people are doing mechanical turk? Are they 1:1 your peers, colleagues? Or are they unde
by rootsudo 5y ago
Because you're forgetting the other side of the equation, what sort of people are doing mechanical turk?
Are they 1:1 your peers, colleagues?
Or are they underpaid, most likely emerging economy countries, and very overworked labor that you're paying for?
You can browse to the mechanical turk subreddits and you'll hear the other side of the table that they spend 15-20-hours on a task to get what, a few dollars?
Pay more, get better results. The system itself is designed to exploit.
- catillac 5y agoI have definitely upped the pay and not achieved better results. I don’t think it’s quite as simple a solution as you’re making it out to be. Realistically no matter how much you pay people who don’t have the medium to advanced skills to do the job for whatever reason, they won’t have those skills, at least in the short term.
- georgeutsin 5y agoThose skills are typically built through training anyway, but MTurk doesn't seem to have the necessary training pipeline.
- tedunangst 5y agoHow many of your peers and colleagues are regularly checking mturk for suitable well paying tasks?
- notyourwork 5y agoYep! The old saying "you get what you pay for" applies to Mechanical Turk like everything else. We tried outsourcing a project to Mechanical Turk and ended up spending more time on reliability and quality controls than it saved is in doing the manual work ourselves.