3 ms·
It's all about how much you pay the turkers. I have done many studies on mturk and the quality of results have been very good so far. My secret? Pay people equi
by huahaiy 14y ago
It's all about how much you pay the turkers. I have done many studies on mturk and the quality of results have been very good so far. My secret? Pay people equitable wages.
I always do a small pilot study to find out how long on average does my task take people to do. Then price the HIT so that people can get at least $6 an hour, sometimes much more.
This way, I get high quality results very fast. For example, I posted 100 assignments at 11am today, each took about 10 minutes to do, and now it is 1:40pm, and I have already gotten all the results I need.
Compared with having to pay $20 for people to come to my lab for an hour, mturk is heaven.
- anandkulkarni 14y agoThat's a terrific strategy, and that's one of the strategies we apply internally here at MobileWorks. Treating folks fairly is the right way to get good results. We tie price to task time explicitly, to prevent folks from underpaying MobileWorkers. This makes sure results come back right. You can read our IEEE paper for details: http://www.cs.berkeley.edu/~bjoern/papers/kulkarni-mobileworks-ieee2012.pdf http://www.cs.berkeley.edu/~bjoern/papers/kulkarni-mobilewor...
- technotony 14y agoThat is great. When I was working in the Philippines for a microfinance bank I had some of my staff work on mTurk during a quiet period and they were barely earning local minimum wage from the work. Croudsourcing work like this offers great potential to get income into poor, under-employed regions of the world but we can't let it become the new sweatshop.