3 ms·
Totally valid. We do multiple comparison protection on ANOVA post hoc tests, but not across all analyses. Ultimately we'll need to address this. Hopefully doin
by glaugh 14y ago
Totally valid. We do multiple comparison protection on ANOVA post hoc tests, but not across all analyses.
Ultimately we'll need to address this. Hopefully doing so (automatically) will differentiate Statwing from other stats package, where one is quite free to shoot one's self in the foot (and one often does).
We'll count this as a vote for the prioritization of that feature.
Thanks for the comment, really appreciate it.
- tel 14y agoHonestly, I wrote is as a disguised compliment. Doing tests quickly makes statistical validation available and that is solidly better than winging it because you can't be bothered to do the math. I did a bit of brainstorming previously about penalties and negative feedback controls for hypothesis testing in a medical context. The metaphor I liked was that you are buying hypothesis tests with data and therefore there is a penalty risk for each attempted test. I never worked out the math very thoroughly, but I'd love to see how a system like that would work live. I think it'd be an amazing boon to your system to have these kinds of feedback. You'd not only be easy and available but also trusty since you make sure you never promise too much. Very cool project.