14 ms·
Looks great-- as I mentioned in another comment, I'm definitely considering how we might use this. We have a number of sites with user-generated content and not
by thorax 17y ago
Looks great-- as I mentioned in another comment, I'm definitely considering how we might use this. We have a number of sites with user-generated content and not enough hours in the day to review it all.
Regarding your semi-automated plans:
* What's the process for evaluating false positives/negatives?
* What guarantee do you provide against incorrect results? I know you have each item moderated 3 times, but it's still a worry. What if porn gets by?
* I assume your team will be able to handle really terrible objectionable content uploaded by griefers? The kind of stuff no human should have to see?
* I feel you should mention MTurk usage on your site somewhere. "How" you perform the automated pieces was one of the biggest questions I had, and I would not have purchased without emailing you to find out if you outsourced externally, used Amazon, or what-have-you.
* What's the turnaround time like for the moderation? Any estimates on that depending on the content?
Thanks in advance.
- maccman 17y ago* We have two rounds, each round is voted on by three people, if there's disagreement on the verdict in the first round, it goes to the second round. If the second round disagrees - the items is failed as a precaution. * We only provide a money back guarantee. We don't charge enough to cover any insurance. If you need that we've partnered with moderation companies who offer insurance (cover obviously depends on the amount of moderation you need). * Yes, the Turkers are all warned. * I think you're right. Initially I thought it it would be a turn off - but in retrospect that was a mistake. * Very quick, it's about 7 seconds per item (once it's on mturk). Items are batched up into 20 and sent off every minute - so the complete turnaround will be a bit longer. Let me know if you've any more queries.