3 ms·
That's... not what statistical significance means. All statistical significance means is that there's a less than five percent chance of getting that result at
by cwyers 12y ago
That's... not what statistical significance means. All statistical significance means is that there's a less than five percent chance of getting that result at random, if the null hypothesis were true. Now, granted, most studies reported on find p-values well below the .05 threshold. But still, if you go out and count the number of studies published in a year, one percent of them is still a LOT of wrong studies. And remember that, due to publication bias, it's a biased sample of the population of studies. So for every 100 studies that are examining a hypothesis that is in reality false, you'll get 4-5 that get a statistically significant finding instead. And it's those few studies that end up getting published.
- aaron695 12y agoThis is also not true. For starters many studies don't use a p value of .05. People seem to have read one xkcd comic and think now all studies are false. There are issues, especially were the people doing the studies want a particular outcome for financial gain. But if there are issues with this study talk about them. Were are the other 19 studies they have hidden? Where have they not followed proper statistical practice? How does the other 6 theoretical experiments on the same paper which some also have significance come into it?