Yeah, I agree. I think the MTurk is not a great approach. Researchers rely on it too much because it's easier to implement than other options. On the other hand

Yeah, I agree. I think the MTurk is not a great approach. Researchers rely on it too much because it's easier to implement than other options. On the other hand, if I were a reviewer of the Piff article, I personally wouldn't have let it pass peer-review as-is. The entire article is based on an unvalidated wealth model. I see this quite a bit with research that comes for peer review: 1) We have this model, 2) Look at all these neat findings we extrapolate from this model They are missing the intermediate step that shows the model measures what it's supposed to. In this case, they never validate that car make/model is a good proxy for wealth. The entire premise is based on a book titled "Luxury Fever"[1] and not on peer-reviewed research. They never actually explain this model, either. What cars are mapped to their 1-5 scale? Is a Lincoln a 5 or a Ferrari? No idea. There's contradictory evidence that many wealthy people drive Hondas and Fords and that less-wealthy people buy luxury cars as a pseudo-status symbol. That's why symbols of wealth (clothes, cars, etc.) are a bad model for actual wealth, especially in a society with a large debt burden and when the models go unvalidated. There are other questions I would have, like small-ish sample sizing, to basing the entire study in Berkeley, to only doing the traffic study between 2-5pm. I would question how well that study can be extrapolated. If you do a quick Bayesian statistical significance test on their vehicle data, it doesn't appear statistically significant. But they report correlations instead. All that to say, there's a lot of contradictory evidence on both sides. Social science is hard, and I was trying to make the main point that we need to be very careful about making strong and broad claims from limited evidence. And I say this as someone who drives a bargain-basement hatchback with mechanical windows :-)