This issue isn't just with students or compensation. A lot of the quality issues have more to do with serious questions of reading comprehension and the over us

This issue isn't just with students or compensation. A lot of the quality issues have more to do with serious questions of reading comprehension and the over use of (poorly designed) survey methodologies. It ends up being a lot like the 'democracy' complaints...its not a great method but it is better than all the others for what it does. Not only are 'attention check questions' common, there is some interesting research on their effectiveness. Eventually, I suspect/hope that NLP and neural networks will enable more authentic data collection across many spectrums.