>Unlike turkers, grad students produce much cleaner data and also see the data first hand. Which is important. I consider mturk/offshore as a necessary evil, ra

>Unlike turkers, grad students produce much cleaner data and also see the data first hand. Which is important. I consider mturk/offshore as a necessary evil, rather than a panacea that will "make research easier and speed it up". This is what we are trying to solve. You can get good clean data from crowdsourcing too if you give it out to the most suitable workers and have them work collaboratively.