3 ms·
Worth repeating: > Problems of non-reproducibility, publication bias, data faking, lack of transparency, and the like plague every scientific field.
by leereeves 11y ago
Worth repeating:
> Problems of non-reproducibility, publication bias, data faking, lack of transparency, and the like plague every scientific field.
- thaumaturgy 11y agoYes. There's a good article on this from a few years back that began to popularize a term for this, called the "Decline Effect": http://www.newyorker.com/magazine/2010/12/13/the-truth-wears-off http://www.newyorker.com/magazine/2010/12/13/the-truth-wears... (oblig.: author is disgraced science journalist Jonah Lehrer, but this is one of his pieces that has stood up to all scrutiny). The most straightforward explanation, mentioned in the article and in some of the /r/science thread comments, is that null results are much harder to publish than positive results. This is not limited to the field of psychology. All that said, I'm really excited by this paper and by the gradually increasing interest in this problem.
- paulmd 11y agoIt's a particular problem with the "soft" sciences, though. For example, psychology is tough because you can't read people's minds, you have to go with how it affects their behavior in some measurable way or how they feel about it, and there's a tremendous number of confounding variables. Economics is another tough one, because experiments are not isolated from exogenous conditions and thus cannot really have a control. The whole thing is also highly interrelated with psychology as well. I'd throw poli-sci in that category too. At least in physics somebody else can set up the same experiment and run it again. Sure, the same tendencies to publication bias, etc apply, but usually within a few years to a decade such things are discovered, corrected, and the problem identified. It's much harder to identify what resulted in the change of outcome for a soft-science experiment.
- thaumaturgy 11y agoThis is addressed a bit in the Reddit thread, where the comments from practicing scientists seem to mostly agree with you. Mathematicians are claiming they aren't affected at all, physicists are claiming that disproving a major theory in physics would get you a Nobel instead of scorn, and the bioscientists saying it's a bigger problem in their field. That said, I think it's dangerous to give any branch of science an automatic pass on this. The fundamental causes of the Decline Effect aren't limited to the "soft" sciences, they just currently seem to have a more susceptible culture.
- deleted 11y ago[deleted]