3 ms·

Not exactly the same, but there's this interesting quiz that presents a number of studies that appeared in Science and Nature and asks you to guess which failed

Not exactly the same, but there's this interesting quiz that presents a number of studies that appeared in Science and Nature and asks you to guess which failed to replicate: https://80000hours.org/psychology-replication-quiz/ https://80000hours.org/psychology-replication-quiz/ . After taking that the result in this paper doesn't surprise me. I'm educated, but not in Psychology, and I think most people can tell which studies are more likely to fail to replicate.

IshKebab 6y ago
Great quiz! I got 14/15 right. Pretty easy to tell I thought - it seems like all the bullshit ones are "people who do done activity then behave differently when doing some completely unrelated task". Do psychologists dream up interesting self-help style headlines and then try and prove them? "Spending 5 minutes a day thinking about sex could make you live 10 years longer!"
- smogcutter 6y ago
  Yeah, they’re all priming studies. Afaik that was hot shit for a while but has been mostly discredited. See “power poses” for a dumb way it trickled into pop culture.
ALittleLight 6y ago
The last time I took this quiz I got them all right. I just used the heuristic "Would I expect this to be true regardless of whether this paper existed?"
- gweinberg 6y ago
  Yeah, that works unless the quiz is cherry-picked to demonstrate the opposite.
- srtjstjsj 6y ago
  So things they do you believe are common sense fail to replicate?
  - ALittleLight 6y ago
    The reverse. Things that seem to be common sense are true, and things that seem surprising and weird are false. As an example: "If subjects hold a heavier clipboard they feel more authoritative" - that's a pretty unexpected and surprising result. I expect it won't replicate. "People will give more to a charity if the overheard for that charity is already covered." That feels pretty common sense to me. If you're donating, you probably want your money to go to the cause, and not the overhead of the organization gathering donations etc.
deleted 6y ago
[deleted]
gnicholas 6y ago
My six year old got nearly all of these correct (including one I guessed incorrectly).

IshKebab 6y ago

Great quiz! I got 14/15 right. Pretty easy to tell I thought - it seems like all the bullshit ones are "people who do done activity then behave differently when doing some completely unrelated task". Do psychologists dream up interesting self-help style headlines and then try and prove them? "Spending 5 minutes a day thinking about sex could make you live 10 years longer!"

smogcutter 6y ago
Yeah, they’re all priming studies. Afaik that was hot shit for a while but has been mostly discredited. See “power poses” for a dumb way it trickled into pop culture.

ALittleLight 6y ago

The last time I took this quiz I got them all right. I just used the heuristic "Would I expect this to be true regardless of whether this paper existed?"

gweinberg 6y ago
Yeah, that works unless the quiz is cherry-picked to demonstrate the opposite.
srtjstjsj 6y ago
So things they do you believe are common sense fail to replicate?
- ALittleLight 6y ago
  The reverse. Things that seem to be common sense are true, and things that seem surprising and weird are false. As an example: "If subjects hold a heavier clipboard they feel more authoritative" - that's a pretty unexpected and surprising result. I expect it won't replicate. "People will give more to a charity if the overheard for that charity is already covered." That feels pretty common sense to me. If you're donating, you probably want your money to go to the cause, and not the overhead of the organization gathering donations etc.

deleted 6y ago

[deleted]

gnicholas 6y ago

My six year old got nearly all of these correct (including one I guessed incorrectly).