3 ms·
CrowdFlower has some annoying particularities which are undocumented. In particular: The CSV parser doesn't work / is too strict / something. The only way to
by bravura 16y ago
CrowdFlower has some annoying particularities which are undocumented.
In particular:
The CSV parser doesn't work / is too strict / something. The only way to upload complicated data files in as "JSON". The only problem is they don't accept standard JSON. You cannot have a comma separating the rows. (!?) I have no idea how much time I spent trying to figure this out.
Additionally, if your task is too hard, and more than 50% of judgments are rejected, they auto-pause your task. When you resume it, it will simply pause a few minutes later. So, for certain tasks, you simply cannot finish the job. Their rationale is that CrowdFlower pays for the judgments that are discarded, and you pay for only the judgments they keep, so if they discard too many judgments they lose money. I would rather just pay extra money for tasks that are very hard.