3 ms·
You are correct - it was not a study, since that would require studying some empirical data instead of making up values. It was actually an essay, akin to a gue
by ChrisLomont 5y ago
You are correct - it was not a study, since that would require studying some empirical data instead of making up values. It was actually an essay, akin to a guest blog post, but for a journal [0].
Look at his paper - it clearly relies on values that he made up - there is not a single measurement of actual papers to fill in his formulas.
What he did was show it was possible for stuff to be wrong, given values he pulled out the air. When people did studies to measure those values from real papers, which Ioannidis did not, they found his made up values far from reality. For example, this paper shows how to do actual measurements of the values Ioannidis made up [1].
Here's one [2] (of many) paper showing that Ioannidis did not prove the claim people think he did for other reasons.
Carefully read the actual original paper, and note that there are many values to input to his model, that he hand waves over and does not actually measure.
[0] https://journals.plos.org/plosmedicine/article?id=10.1371/journal.pmed.0020124&xid=17259,15700019,15700186,15700190,15700248 https://journals.plos.org/plosmedicine/article?id=10.1371/jo...
[1] https://arxiv.org/ftp/arxiv/papers/1301/1301.3718.pdf https://arxiv.org/ftp/arxiv/papers/1301/1301.3718.pdf
[2] https://econpapers.repec.org/article/plopmed00/0040168.htm https://econpapers.repec.org/article/plopmed00/0040168.htm
- buescher 5y agoYeah, the papers you cite both basically start "Look, we know you all abuse the heck out of p-values and you really should stop (wink wink nudge nudge) doing that" and go on to "gee, if you start with much more optimistic assumptions than Ioannidis, then you don't come to such rhetorically devastating conclusions". Of course, he's a very bad man for pointing all this out, isn't he?
- ChrisLomont 5y agoNo, if you read my the papers you'd learn his claim, based not on measuring papers,but on guessing, is wrong. When people measured the required items, his conclusion is not supported by evidence. Ioannidis made assumptions that didn't hold up under empirical testing. End of story. Measurement trumps belief. I gather you prefer conclusions based on feelings. I prefer my science to measure things to discard invalid claims.
- buescher 5y agoWhy, I'm an emotional wreck I guess to notice these things! Maybe when you calm down you can examine the assumptions behind the method of examining p-values in the paper you cited.