3 ms·
"...Ian Roberts, professor of epidemiology at the London School of Hygiene & Tropical Medicine, began to have doubts about the honest reporting of trials after
by mcguire 5y ago
"...Ian Roberts, professor of epidemiology at the London School of Hygiene & Tropical Medicine, began to have doubts about the honest reporting of trials after a colleague asked if he knew that his systematic review showing the mannitol halved death from head injury was based on trials that had never happened. He didn’t, but he set about investigating the trials and confirmed that they hadn’t ever happened. They all had a lead author who purported to come from an institution that didn’t exist and who killed himself a few years later. The trials were all published in prestigious neurosurgery journals and had multiple co-authors. None of the co-authors had contributed patients to the trials, and some didn’t know that they were co-authors until after the trials were published. When Roberts contacted one of the journals the editor responded that “I wouldn’t trust the data.” Why, Roberts wondered, did he publish the trial? None of the trials have been retracted."
I realize that meta-analysis is regarded as a valid research method, if not one of the best, but honestly, I don't know why. If the original studies are garbage, no amount of statistical manipulation is going to make them not-garbage.
- FeteCommuniste 5y agoMeta-analysis normally tries to exclude "low-quality" studies but if the standard of honesty in a field or sub-field is truly abysmal, I guess it's GIGO.
- metalliqaz 5y agowell if the original studies are inadequate simply because N is too low, then grouping many of them can resolve that problem.
- mahogany 5y agoIs that really true from a statistical standpoint? It seems to me that running ten 20-person studies is different and less valuable than running a single 200 person study, because each of the 20-person studies has a much larger error range that you have to account for. But I'm also not good with stats.
- mcguire 5y agoThat's ideally what the meta-analysis is supposed to correct for. But if two of the studies are just completely made up and another couple have errors in their design that aren't mentioned in the write-up....
- bjornsing 5y agoHow do you correct for publication bias in these meta analyses? I really hope they do correct for it…