4 ms·
It's mostly because Crowfdlower does some additional filtering: they have an algorithm that rates workers, and bases it's trust in the worker on how well he doe
by PanMan 17y ago
It's mostly because Crowfdlower does some additional filtering: they have an algorithm that rates workers, and bases it's trust in the worker on how well he does compared to others.
It also does some magic on resubmitting a unit as long as the results aren't clear yet.
Also you can set some "gold" units: assignments you have done yourself, so you know the right answer. This can be used to test if the workers are actually trying, instead of just clicking random stuff.
While I could have built all that myself, Crowdflower already does this, and has a bit simpler API to boot, than Mturk itself.
- jacquesm 17y agoNeat! I tried signing up for mturk a few weeks ago as a customer but they wouldn't accept me because of the location of the company. Pretty disappointing. I hope they open that up sooner or later (rather sooner), it seems to be a little roundabout to have to register another company just to be able to use mturk.
- PanMan 17y agoI actually also tried signing up for mTurk. And while I guess it's not how it's supposed to work, I could sign up after looking up a random NY zipcode. Not 100% sure about the billing tho, but I do know non-americans who have used Mturk before, and supposedly also paid for it.