3 ms·
> Something is really wrong in science, and this is just the beginning. >But since no PI ,including me, wants to jeopardize their career, I fear things are goin
by biomcgary 9y ago
> Something is really wrong in science, and this is just the beginning.
>But since no PI ,including me, wants to jeopardize their career, I fear things are going to go off a cliff.
I think part of the decline in biology specifically may be the rapid growth of NIH funded research in the 90's due to the success of molecular biology and the necessity of many warm bodies at the bench, which was followed by the NIH budget "crunch" of the last decade. This combination dramatically increased the competitive nature of getting grants and high-impact papers. In this environment, those who are careful in their claims are selected out of the career pool (not all obviously, but enough to affect the proportion).
A couple of my experiences:
I had one paper in a mid-range journal where we found a very interesting biological pattern in the data, which we discussed but ultimately decided to dismiss because there were confounding factors. A very well known lab took the exact same data, did a couple minor experiments to justify dismissing our concerns, and published in a top-tier journal.
In another case, I reviewed a paper from a VERY famous lab and their own metrics proved that 95% of the data was noise. They simply removed the offending metrics and published in a different, equally high-profile journal.
- arkh 9y ago> we found a very interesting biological pattern in the data Isn't it related to p-hacking? Get lot of data, search for a pattern then publish some theory the pattern would "prove". Instead of having a theory first, setting up experiments which can disprove it then analyzing the data from those experiments.
- mercer 9y agoI'd say if they were explicit about using the data to construct a theory, it's okay, no?
- biomcgary 9y agoThe observed pattern exactly fit into a previously established hypothesis and was totally unexpected. I did not slice and dice the data with multiple statistical tests. The only way it could have been related to p-hacking is that I am familiar with a bunch of biological theories and could recognize data patterns that are compatible with any of them. So, maybe a Bonferroni-type correction of 30-70x (i.e., number of theories my internal neural net has been trained on)?