2 ms·
@maxmcd: a quick intro to publication bias: http://en.wikipedia.org/wiki/Publication_bias http://en.wikipedia.org/wiki/Publication_bias Imagine you're testing
by qiqing 14y ago
@maxmcd: a quick intro to publication bias:
http://en.wikipedia.org/wiki/Publication_bias http://en.wikipedia.org/wiki/Publication_bias
Imagine you're testing the efficacy of a new drug, which has a close-to-neutral or neutral effect (to keep things simple), and there are n labs testing it. You might expect there to be a normal distribution of effect around a mean of zero (whatever quantity we're measuring). However, the groups who didn't find any effect decided to not publish their null results for any minor technicality or due to some pressure like (e.g. are you sure you don't want to repeat this experiment?)
Left as an exercise: if you observe only at what got published, what do you expect to see?
That being said, there's obviously more than just your garden variety publication bias and conflict of interest at play here.
- Tenoke 14y agoThe bigger problem in this situation in my opinion are the obsever-expectancy effect and the confirmation bias: http://en.wikipedia.org/wiki/Observer-expectancy_effect http://en.wikipedia.org/wiki/Observer-expectancy_effect http://en.wikipedia.org/wiki/Confirmation_bias http://en.wikipedia.org/wiki/Confirmation_bias If you expect or are looking for specific results you are likely to unconsciously manipulate the experiment in order to find them. And when big corporations are involved uncounscious manipulation is often the smaller problem..