5 ms·

P values of less than .005 generally mean that you accept the null hypothesis. The authors did otherwise for one hypothesis, which I find interesting.

alexandercrohde 9y ago
You're wrong on two accounts. You want a low p-value, the lower the p-value the stronger the evidence. A p-value is cutoff traditionally at .05 (1 in 20), and if it's p < .05 you can reject the null hypothesis. The "null hypothesis" is the OPPOSITE of your paper's hypothesis (so you want to reject it): the null hypothesis is "All the variation we saw was from chance"
- nonbel 9y ago
  Why not make the null hypothesis the same as your paper's hypothesis? Wouldn't that make more sense?
  - themadryaner 9y ago
    You cannot prove the null hypothesis; you can only disprove it. The p-value is the probability that the null hypothesis is true. So if the null hypothesis is that there is no difference, and there is a low probability of that being true, then you have shown that there is a difference between the groups. If the p-value is high, you do not show that the null hypothesis is true. Instead, you show that you did not find a statistically significant difference. This can happen when the difference between the values is small or there is not enough data to make the difference clear, which is why a high p-value is not enough to reject the alternative hypothesis.
    - jostylr 9y ago
      > The p-value is the probability that the null hypothesis is true. No, the p-value is the probability that the given data generated is as far away or farther by random chance given the null hypothesis is true. That is to say, we assume the null hypothesis to make some predictions and see if the data is a likely occurrence under those assumptions. This is not the same as the probability that the null hypothesis is true. If that is what you want (and most of us do want this), then Bayesian methods are more appropriate though they are more complicated and more sensitive to initial assumptions.
    - nonbel 9y ago
      >"You cannot prove the null hypothesis; you can only disprove it." Sure, but thats why the null hypothesis should be predicted by your theory. Then you are checking your theory. Most people could care less about whether there is a miniscule difference between groups or not. >"The p-value is the probability that the null hypothesis is true." No, as pointed out by jostylr this is wrong.
  - fnovd 9y ago
    The null hypothesis signifies a lack of relatedness. Give circumstance A and outcome B, we make no assumptions, i.e. we assume A and B are unrelated by not assuming they are related. This is the null hypothesis. In order to reject that, we must provide compelling evidence. If you start by assuming A and B are related, your experiment would have to fail reject that notion in order to prove that A and B are indeed related, which is a less direct way of approaching scientific discovery.
    - nonbel 9y ago
      You are also confused about the meaning of "null": https://news.ycombinator.com/item?id=15703503 https://news.ycombinator.com/item?id=15703503
      - bkberry352 9y ago
        No, they're not. The commonly accepted definition of Null Hypothesis is "the hypothesis of no effect or no relationship" (source: statistics master's degree, but it's also the first sentence in the wikipedia article: https://en.wikipedia.org/wiki/Null_hypothesis https://en.wikipedia.org/wiki/Null_hypothesis)
        nonbel 9y ago
        That is an awful wikipedia page. How can that even make sense? As soon as people start predicting things it is impossible to test the prediction? Also, the intro of that page contains blatantly incorrect statements: >"In the significance testing approach of Ronald Fisher, a null hypothesis is rejected if the observed data are significantly unlikely to have occurred if the null hypothesis were true. In this case the null hypothesis is rejected and an alternative hypothesis is accepted in its place." There is no alternative hypothesis in Fisher's significance testing. Here is a better wikipedia page: "We may, however, choose any null hypothesis we please, provided it is exact."-Ronald Fisher https://en.wikipedia.org/wiki/The_Design_of_Experiments https://en.wikipedia.org/wiki/The_Design_of_Experiments I've heard that a lot of math fields really fail to teach history, perhaps that is what happened in your stats program.
  - systoll 9y ago
    The mathematics of statistical hypothesis testing is almost always defined in terms of a ‘null’ and an‘alternative’ hypothesis, where the ‘null’ necessarily includes the equivalent of ‘no correlations/differences exist’ and the alternative hypothesis does not. This usually means that the alternative hypothesis is the ‘interesting’ one, which is probably what the researcher would like to occur. Which maybe isn’t entirely intuitive. But I f you don’t follow those restrictions, the math is meaningless. If you swap the terms in the math, you’ll confuse anyone who knows the stats, while not really benefitting anyone. And if you’re not using the math, why refer to a ‘null’ and ‘alternative’ hypothesis at all?
    - nonbel 9y ago
      >"the ‘null’ necessarily includes the equivalent of ‘no correlations/differences exist’" "Null" stands for hypothesis to be nullified in this case, not zero.
  - jostylr 9y ago
    Take as an example the standard null hypothesis of the means of two groups being the same. This is a very concrete condition that is amenable to having predictions made from it. But now let's say that you assume they are different. Well, how different are they? You need to make that choice in order to get predictions. And then your rejection is not a rejection of "being different" but "being different in this one specific way".
    - nonbel 9y ago
      >'But now let's say that you assume they are different. Well, how different are they? You need to make that choice in order to get predictions. And then your rejection is not a rejection of "being different" but "being different in this one specific way".' Yes, precisely. You should predict a specific thing will happen based on some theory and check it with data. This sounds like the science we learned about in school. Only predicting "there should be some difference" with your theories is more like astrology or something.

alexandercrohde 9y ago

You're wrong on two accounts. You want a low p-value, the lower the p-value the stronger the evidence. A p-value is cutoff traditionally at .05 (1 in 20), and if it's p < .05 you can reject the null hypothesis. The "null hypothesis" is the OPPOSITE of your paper's hypothesis (so you want to reject it): the null hypothesis is "All the variation we saw was from chance"

nonbel 9y ago
Why not make the null hypothesis the same as your paper's hypothesis? Wouldn't that make more sense?
- themadryaner 9y ago
  You cannot prove the null hypothesis; you can only disprove it. The p-value is the probability that the null hypothesis is true. So if the null hypothesis is that there is no difference, and there is a low probability of that being true, then you have shown that there is a difference between the groups. If the p-value is high, you do not show that the null hypothesis is true. Instead, you show that you did not find a statistically significant difference. This can happen when the difference between the values is small or there is not enough data to make the difference clear, which is why a high p-value is not enough to reject the alternative hypothesis.
  - jostylr 9y ago
    > The p-value is the probability that the null hypothesis is true. No, the p-value is the probability that the given data generated is as far away or farther by random chance given the null hypothesis is true. That is to say, we assume the null hypothesis to make some predictions and see if the data is a likely occurrence under those assumptions. This is not the same as the probability that the null hypothesis is true. If that is what you want (and most of us do want this), then Bayesian methods are more appropriate though they are more complicated and more sensitive to initial assumptions.
  - nonbel 9y ago
    >"You cannot prove the null hypothesis; you can only disprove it." Sure, but thats why the null hypothesis should be predicted by your theory. Then you are checking your theory. Most people could care less about whether there is a miniscule difference between groups or not. >"The p-value is the probability that the null hypothesis is true." No, as pointed out by jostylr this is wrong.
- fnovd 9y ago
  The null hypothesis signifies a lack of relatedness. Give circumstance A and outcome B, we make no assumptions, i.e. we assume A and B are unrelated by not assuming they are related. This is the null hypothesis. In order to reject that, we must provide compelling evidence. If you start by assuming A and B are related, your experiment would have to fail reject that notion in order to prove that A and B are indeed related, which is a less direct way of approaching scientific discovery.
  - nonbel 9y ago
    You are also confused about the meaning of "null": https://news.ycombinator.com/item?id=15703503 https://news.ycombinator.com/item?id=15703503
    - bkberry352 9y ago
      No, they're not. The commonly accepted definition of Null Hypothesis is "the hypothesis of no effect or no relationship" (source: statistics master's degree, but it's also the first sentence in the wikipedia article: https://en.wikipedia.org/wiki/Null_hypothesis https://en.wikipedia.org/wiki/Null_hypothesis)
      - nonbel 9y ago
        That is an awful wikipedia page. How can that even make sense? As soon as people start predicting things it is impossible to test the prediction? Also, the intro of that page contains blatantly incorrect statements: >"In the significance testing approach of Ronald Fisher, a null hypothesis is rejected if the observed data are significantly unlikely to have occurred if the null hypothesis were true. In this case the null hypothesis is rejected and an alternative hypothesis is accepted in its place." There is no alternative hypothesis in Fisher's significance testing. Here is a better wikipedia page: "We may, however, choose any null hypothesis we please, provided it is exact."-Ronald Fisher https://en.wikipedia.org/wiki/The_Design_of_Experiments https://en.wikipedia.org/wiki/The_Design_of_Experiments I've heard that a lot of math fields really fail to teach history, perhaps that is what happened in your stats program.
- systoll 9y ago
  The mathematics of statistical hypothesis testing is almost always defined in terms of a ‘null’ and an‘alternative’ hypothesis, where the ‘null’ necessarily includes the equivalent of ‘no correlations/differences exist’ and the alternative hypothesis does not. This usually means that the alternative hypothesis is the ‘interesting’ one, which is probably what the researcher would like to occur. Which maybe isn’t entirely intuitive. But I f you don’t follow those restrictions, the math is meaningless. If you swap the terms in the math, you’ll confuse anyone who knows the stats, while not really benefitting anyone. And if you’re not using the math, why refer to a ‘null’ and ‘alternative’ hypothesis at all?
  - nonbel 9y ago
    >"the ‘null’ necessarily includes the equivalent of ‘no correlations/differences exist’" "Null" stands for hypothesis to be nullified in this case, not zero.
- jostylr 9y ago
  Take as an example the standard null hypothesis of the means of two groups being the same. This is a very concrete condition that is amenable to having predictions made from it. But now let's say that you assume they are different. Well, how different are they? You need to make that choice in order to get predictions. And then your rejection is not a rejection of "being different" but "being different in this one specific way".
  - nonbel 9y ago
    >'But now let's say that you assume they are different. Well, how different are they? You need to make that choice in order to get predictions. And then your rejection is not a rejection of "being different" but "being different in this one specific way".' Yes, precisely. You should predict a specific thing will happen based on some theory and check it with data. This sounds like the science we learned about in school. Only predicting "there should be some difference" with your theories is more like astrology or something.