4 ms·
I upvoted this. Just because we need more reminders of how awful published research can be...and yet, I'll be the first to admit that upon seeing the headline,
by danso 11y ago
I upvoted this. Just because we need more reminders of how awful published research can be...and yet, I'll be the first to admit that upon seeing the headline, I thought: "Oh yeah, that makes sense, my rich friend Bob is the biggest xenophobe I know", mixed in with "Fucking facebook and their ice-bucket-dumping morons" type of faux-highbrow sentiment.
Just like headlines are a standardized way of trumpeting a claim, it'd be nice to have a semi-standardized format for quantifying the scope and details of methodology.
edit: The more interesting part was the first "micro" study, in which people consented to handing over their FB network. But reading the actual details gives me additional doubt, though I can't say I'm very knowledgeable about what's been done so far to correct for MTurk quality issues in academic studies:
http://www.sciencedirect.com/science/article/pii/S0191886915004973 http://www.sciencedirect.com/science/article/pii/S0191886915...
> We recruited 1069 individuals from Amazon's Mechanical Turk who lived in the United States to participate in the study in exchange for $1.00....
> [in the conclusion]... Second, our sample in Study 1 consisted of MTurk users which are not representative of the general US population. While MTurk users tend to be as good—if not better—than typical undergraduate samples (Buhrmester, Kwang, & Gosling, 2011), future work should endeavor to recruit a nationally representative sample to further corroborate the results.
edit2: I'm kind of interested in the type of person who, over MTurk or not, would hand over their Facebook network for a dollar? I mean I'm sure lots of people would do that, but still...
And the study they reference in terms of claiming that MTurk users are more representative than the undergrads that studies usually pick from...The study was done in 2011. I know MTurk has been around for awhile, but has much changed about its demographic? For example, I'd be very suspicious of a study based on Uber that depended on driver analysis from even as late as 2014, given the kind of turnover that has happened.