3 ms·
That reminds me of the social sciences (and their replication crisis). There's nothing wrong with effects that only apply very narrowly, or medical techniques
by eru 6y ago
That reminds me of the social sciences (and their replication crisis).
There's nothing wrong with effects that only apply very narrowly, or medical techniques that only work for one person.
What is wrong is to use the defence that 'every case is different' and 'well, it will work if the right person does it properly in the right case' one the one hand, but claim universal applicability of your techniques or results on the other.
See also motte-and-bailey fallacy.
- phreeza 6y agoIs it even possible in today's evidence based framework to consider a treatment that only works for a single patient? I think you'd need at least an entire class of such treatments applying to a group of patients to do any kind of RCT or similar study.
- eru 6y agoWell, if RCT is your only standard of evidence, then you need multiple people almost by definition. But it's not the only standard of evidence used. Famously, there has never been an RCT for parachutes. (Until recently that is, see https://healthjournalism.org/blog/2019/02/breakthrough-research-reveals-parachutes-dont-prevent-death-when-jumping-from-a-plane/ https://healthjournalism.org/blog/2019/02/breakthrough-resea... )
- barry-cotter 6y ago> That reminds me of the social sciences (and their replication crisis). It’s not a social science replication crisis. One of the central papers in this rediscovery of bad statistical practice was Ioannides “ Why Most Published Research Findings Are False” https://journals.plos.org/plosmedicine/article?id=10.1371/journal.pmed.0020124 https://journals.plos.org/plosmedicine/article?id=10.1371/jo... and Bayer’s internal research finds most preclinical cancer studies don’t replicate. http://www.readthehook.com/103149/junk-science-most-preclinical-cancer-studies-dont-replicate http://www.readthehook.com/103149/junk-science-most-preclini...
- thaumasiotes 6y ago> There's nothing wrong with effects that only apply very narrowly, or medical techniques that only work for one person. There's no way to tell the difference between a technique that only works for one person and a technique that works for zero people.