3 ms·

p-values are extremely useful for two things: 1. Teaching people who specialise in context areas (chemists, engineers) a pragmatic way to make a decision from

p-values are extremely useful for two things: 1. Teaching people who specialise in context areas (chemists, engineers) a pragmatic way to make a decision from data in the presence of randomness. 2. Automating analyses. (remember your Benjamini-Hochberg) I'd never actually use it myself. Jeepers, just look at the picture.

travjones 11y ago
I agree with #2, but I don't agree with #1. Why would one need a p-value to make a decision about the significance of a change in a dependent variable? Confidence intervals provide more information than p-values, and you can use them to identify significant effects. Moreover, p-values do not indicate the effect size that was observed. Thus, a very small effect in a very large sample can have a low/significant p-value.
- hessenwolf 11y ago
  p-value testing and confidence interval testing are not interchangeable? also, p-values are used to determine the number of effects in a mixed model, or the number of factors in an ANOVA, etc. Sometimes confidence intervals on abstract parameters can be a bit less useful.
  - travjones 11y ago
    You are correct, they are not interchangeable. I didn't suggest that they were. I was offering CIs as an alternative for examining effects in general (e.g., comparing two groups); however, your choice of data representation will always depend on the question that you're asking. Nonetheless, p-values in and of themselves provide no information about the magnitude of an effect. Why not show the actual data?
    - hessenwolf 11y ago
      I guess you mean clinical significance. http://www.bmj.com/content/348/bmj.g2130 http://www.bmj.com/content/348/bmj.g2130 This is a secondary issue. For most non-stats people, I wouldn't recommend the confidence interval as a measure of clinical significance. I'd rather look at the actual distribution of the two effects and view quantiles of the predictive interval. And, yes, in hypthoesis testing, p-values and confidence intervals are generally interchangeable. All they speak of is the overlap of the sample distribution of means, really.
      - deleted 11y ago
        [deleted]

travjones 11y ago

I agree with #2, but I don't agree with #1. Why would one need a p-value to make a decision about the significance of a change in a dependent variable? Confidence intervals provide more information than p-values, and you can use them to identify significant effects. Moreover, p-values do not indicate the effect size that was observed. Thus, a very small effect in a very large sample can have a low/significant p-value.

hessenwolf 11y ago
p-value testing and confidence interval testing are not interchangeable? also, p-values are used to determine the number of effects in a mixed model, or the number of factors in an ANOVA, etc. Sometimes confidence intervals on abstract parameters can be a bit less useful.
- travjones 11y ago
  You are correct, they are not interchangeable. I didn't suggest that they were. I was offering CIs as an alternative for examining effects in general (e.g., comparing two groups); however, your choice of data representation will always depend on the question that you're asking. Nonetheless, p-values in and of themselves provide no information about the magnitude of an effect. Why not show the actual data?
  - hessenwolf 11y ago
    I guess you mean clinical significance. http://www.bmj.com/content/348/bmj.g2130 http://www.bmj.com/content/348/bmj.g2130 This is a secondary issue. For most non-stats people, I wouldn't recommend the confidence interval as a measure of clinical significance. I'd rather look at the actual distribution of the two effects and view quantiles of the predictive interval. And, yes, in hypthoesis testing, p-values and confidence intervals are generally interchangeable. All they speak of is the overlap of the sample distribution of means, really.
    - deleted 11y ago
      [deleted]