4 ms·
The submission title of the submitted article (which does NOT appear as the original title of the article) is probably a hat tip to the famous article by John P
by tokenadult 15y ago
The submission title of the submitted article (which does NOT appear as the original title of the article) is probably a hat tip to the famous article by John P. A. Ioannidis, "Why Most Published Research Findings Are False."
http://www.plosmedicine.org/article/info:doi/10.1371/journal.pmed.0020124 http://www.plosmedicine.org/article/info:doi/10.1371/journal...
The article by Ioannidis, which I think is the most downloaded ever article on PLoS Medicine, is well worth reading for guidance in how to avoid errors in research design.
But to the point of the accuracy of the submission title, what the underlying journal paper
http://www.nature.com/neuro/journal/v14/n9/full/nn.2886.html http://www.nature.com/neuro/journal/v14/n9/full/nn.2886.html
said was, "We reviewed 513 behavioral, systems and cognitive neuroscience articles in five top-ranking journals (Science, Nature, Nature Neuroscience, Neuron and The Journal of Neuroscience) and found that 78 used the correct procedure and 79 used the incorrect procedure. An additional analysis suggests that incorrect analyses of interactions are even more common in cellular and molecular neuroscience." In other words, half the time when the specific issue came up, the neuroscience authors got the procedure wrong.
AFTER EDIT: Meanwhile, a lot of other interesting comments have mentioned the role of statistics education or math-aversion in higher education in various disciplines. I'll comment here about some things I've learned about statistics since I completed my higher education, things I've self-educated about as a homeschooling parent for the last two decades and now a mathematics teacher in private practice.
First of all, even when undergraduate students take courses in statistics, the courses are not likely to be very helpful. Many statistics textbooks used in colleges are poorly chosen
http://statland.org/MAAFIXED.PDF http://statland.org/MAAFIXED.PDF
and many statistics courses are taught by professors who themselves have very poor backgrounds in statistics, so the essential point that statistics is all about DATA never gets emphasized. Moreover, the undergraduate statistics curriculum historically has emphasized the wrong issues about valid inference
http://escholarship.org/uc/item/6hb3k0nz http://escholarship.org/uc/item/6hb3k0nz
and most undergraduates who complete one or two statistics courses still have a very weak sense of what valid statistical inference is.
And all of this is not even to get into issues such as Bayesian versus frequentist approaches to statistics
http://yudkowsky.net/rational/bayes http://yudkowsky.net/rational/bayes
in modeling reality. Yes, biologists need to get over fear of mathematics for biology to progress as a science,
http://www.guardian.co.uk/books/2011/apr/16/mathematics-of-life-ian-stewart-review http://www.guardian.co.uk/books/2011/apr/16/mathematics-of-l...
and everyone can gain by learning more about statistics,
http://knowledge.wharton.upenn.edu/article.cfm?articleid=1928 http://knowledge.wharton.upenn.edu/article.cfm?articleid=192...
but statistics education isn't easy, and it can still be greatly improved even for the students who do step up to take statistics courses.
- disgruntledphd2 15y agoWhile I agree with the major substance of your point (though i never liked that Yodowsky link), you are incorrect in your citation of the paper. The actual paper is: http://www.nature.com/neuro/journal/v14/n9/full/nn.2886.html http://www.nature.com/neuro/journal/v14/n9/full/nn.2886.html It appears to follow on from an extremely controversial paper in neuroscience: Voodoo neuroscience http://escholarship.org/uc/item/51d4r5tn;jsessionid=FB5843BBAF594E6DB5B9FDD9BA745A78 http://escholarship.org/uc/item/51d4r5tn;jsessionid=FB5843BB... If you look at the cited by links in scholar, then you can get access to a raging debate across quite a number of journals (well worth popcorn if you're nerdy and not involved). The crux of the matter for me is that the brain cannot be fruitfully modelled using statistics developed for independent samples. This is going to cause us massive problems unless we can develop better statistical tools (or at the very least use the ones we have more wisely).
- kevinalexbrown 15y agoNo, that's not the crux of the matter. It has nothing to do with the brain per se. The voodoo paper was about people using fMRI improperly analyzing their data, but as the authors point out, there are existing tools that are fine and should have been used. Likewise for the recent Nature Neuro paper.
- bogbrush 15y agoAlthough I've got a good maths degree, I often feel out of my depth beyond fairly basic statistical discussions -- such as these... Particularly in light of the statland.org link above, what would you recommend as good reading material to help me "learn to think like a statastician"?
- cop359 15y agoI think bad statistics education is just a facade that hides what is really happening. Now I don't have proof, but I think the majority of these "errors" are done on purpose. It's far better to fudge your math, get amazing (and wrong) conclusions and then get published in Nature then it is to not get published in Nature. The prestige of getting published in Nature or Science far outweighs the criticism you will get for forging or manipulating your data. In large part because the later can almost never be proven. You can always say you just made a mistake or plead ignorance.