3 ms·
I use mturk a lot at the startup I work for and while I think it is an amazingly powerful tool, one thing to keep in mind for experiments like yours is the numb
by espadagroup 16y ago
I use mturk a lot at the startup I work for and while I think it is an amazingly powerful tool, one thing to keep in mind for experiments like yours is the number of actual unique worker Ids.
For example those 200 responses, I hope you really mean you Looked at the actual number of unique people who accepted hits and thus you actually published a (large) multiple of that 200.
In my experience if you send out 1000 hits, about 70 people will all of them.
There's no way to easily filter so that a worker can only do one hit without some API/iframe trickery.
Just some food for thought.
- StavrosK 16y agoWhat about the "Number of assignments per HIT" field? It says "How many unique workers do you want to work on each HIT?", it sounds to be what is needed here...
- StavrosK 16y agoI just tried it and the workers were, indeed, unique. However, it seems that the feedback was somewhat of low quality, as, for the "would you use it?" question, almost everyone (understandably) said yes (why not, really?). Those who answered no cited privacy concerns, but nothing integral. For the "why would you use it?" question, they mostly repeated the use case I stated above. This was only 10 people, as I wanted to test it out first, but there's my data point for you.