3 ms·
The percent of papers that are fraudulent is probably more like 95+% if you count: - Papers where the authors fabricate data - Papers where bad data is hidden
by Alex3917 14y ago
The percent of papers that are fraudulent is probably more like 95+% if you count:
- Papers where the authors fabricate data
- Papers where bad data is hidden
- Papers with named authors who didn't contribute to the research. (This alone is ~30% of all papers in medical journals.)
- Papers with conflicts of interest that weren't reported.
- Papers with improper usage of statistics.
- Papers where the results and conclusions don't match the data.
- Papers where the results / conclusion aren't epistemologically justified for other reasons.
- Papers that weren't published/written because they showed negative results.
- Papers that don't follow the methodological best practices for their given area of research.
- Papers that incorrectly summarize previous research.
- Papers that rely on flawed assumptions.
- Papers that purposely ask the wrong question(s) in order to mislead the reader.
- Papers that are intellectually dishonest in some other way.
Basically if you want to know the percentage of research that is truly fraudulent when you use a more expansive definition, 95% is probably the lower bound for many if not most academic fields.
- JoeAltmaier 14y agoThat's a persuasive argument. But as a research paper, you would probably rate it as fraudulent by your own criterion. Where did that number '95%' come from? I suspect you made it up. Still, disregarding the irony, a good point.
- Alex3917 14y ago"Where did that number '95%' come from? I suspect you made it up." I don't think there is any research that has a single group of raters look at all of these categories at once, but there is a lot of research that looks at them separately. E.g. as I mentioned, "According to a study published in JAMA, 11 percent of the articles published in peer-reviewed medical journals are written by 'ghost authors.' (And 19 percent of the articles named 'honorary authors' who had not contributed enough to the research and writing to justify being listed as authors.)" That's up to 30% of all papers that are fraudulent right off the bat. Because many of these categories have been looked at separately it's not hard to figure out that the total for all research has to be at least 95%. Also, if you look at what percentage of papers can't be replicated: http://www.newscientist.com/article/mg21528826.000-is-medical-science-built-on-shaky-foundations.html http://www.newscientist.com/article/mg21528826.000-is-medica... It's clear that the vast majority of research seems to be just made up out of thin air to begin with. And the percentage of research that can be replicated but that is fraudulent in some other way is similarly high. What it comes down to is that much if not most of modern science is basically just a giant make-work program for pseudo-intellectuals that's designed to produce marketing propaganda for corporations and prevent political unrest.
- JoeAltmaier 14y ago...and a lot more anecdotal 'evidence'. That article for instance - seems to be a guy with an axe to grind - he's founder of the Science Exchange, a web company with services to sell. By writing a scare story on irreproducible results hes drumming up business. How does that distinguish him from Amgen etc? I'm not trying to be mean, just mentioning its very easy to write opinion that appears as science and gets misinterpreted or given too much weight. The posting about the Decline Effect says it better.
- Alex3917 14y ago"That article for instance - seems to be a guy with an axe to grind" I don't see anything in the article to indicate this, and also the studies he's citing weren't even written by him. And plus it's not like he's the only one to say this, e.g.: http://www.theatlantic.com/magazine/print/2010/11/lies-damned-lies-and-medical-science/308269/ http://www.theatlantic.com/magazine/print/2010/11/lies-damne... I realize that he also has a financial conflict of interest. The difference is that A) he's properly disclosed his conflict of interest and B) he isn't wrong.
- JoeAltmaier 14y agoThe studies he's citing have been cherry-picked by him to support his opinion (that article was published under Opinion). Not seeing the conflict, the bias, is really the problem with current publishing. Most anything that can be published, is. And none of it comes well-labelled. Journalism substitutes for analysis; dry research is summarized carelessly or with stress on the sensational.
- Alex3917 14y ago"The studies he's citing have been cherry-picked by him to support his opinion." What makes you think they have been cherry picked? The studies he cites (and the one by Ionnidis I mentioned) are the only studies of reproducibility that I've seen, and they're the only ones that the Wikipedia article on reproducibility cites.
- gizmo686 14y agoAren't a lot of those exapmles of error, not fraud.