It's funny (or annoying) how charts invite criticism and feature creep. Thanks for an interesting chart. What did you do to cut down on lying human classifier

It's funny (or annoying) how charts invite criticism and feature creep. Thanks for an interesting chart. What did you do to cut down on lying human classifiers? Do you give them an incentive? Did you have them vote as a group on the classification of a sentiment? Whites aren't allowed to say the N word, and Anita can say the S word http://www.youtube.com/watch?v=Qy6wo2wpT2k&t=0m45s http://www.youtube.com/watch?v=Qy6wo2wpT2k&t=0m45s. But maybe your human classifiers can handle this problem too? I hope they got a good grade.