3 ms·
Yes, it's not that the drug companies are actually running trials and random hoping for spurious correlations, but that the traditional measures of statistical
by nkurz 16y ago
Yes, it's not that the drug companies are actually running trials and random hoping for spurious correlations, but that the traditional measures of statistical significance can't be used in cases where trials might be stopped early. Even inspecting the results midway through a trial to see if the effect is being shown is problematic.
Yes, the deviation from expectation really needs to be looked at. The problem is that the financial reward for the companies might be greater to just 'move on' and never publish those unexpectedly negative results. But this means that the unexpectedly positive results for the next test are given undue weight.
I don't think the problem is really the science, or the publishers, or the drug companies, but the unrealistic weight placed on erroneously calculated statistics. This combined with a lot of money at stake forces the companies to "produce results" whether or not this is of long term public benefit.