4 ms·
You're right... you are too lazy. Traditional null hypothesis would be something like "she guesses right 50% of the time", which gives a likelihood of 1/16384
by klodolph 11y ago
You're right... you are too lazy.
Traditional null hypothesis would be something like "she guesses right 50% of the time", which gives a likelihood of 1/16384 that she would get the correct answer. Let's be cynical, and suppose that she knew or guessed that there were 5-7 patients with Parkinson's, the likelihood is now 1/2538, still pretty low. Even if she knew there were exactly 7 patients with Parkinson's (quite a cynical null hypothesis!) the likelihood is only 1/792. Hey, that's a p-value of 0.0012!
Yes, p-values suck. But, the significance is absolutely there, but we would want to follow this research up with a larger sample size and control more of the variables.
- sliverstorm 11y agoI do love how counterintuitive sample sizes are. I swear I see the "it's intuitively obvious that 45 people is a comically small sample size, the researcher is an idiot and this is useless!" comments all the time. Then somebody does the math and it turns out p ≈ 0
- klodolph 11y agoYeah... and then there's the people who benchmark computer programs, don't even bother measuring the test variance, don't know about warming the cache, and post raw timing data online claiming that X is better than Y. Dunning Kruger is a harsh mistress.
- Gravityloss 11y agoLet's apply Bayesian reasoning. :P P(skill): Let's choose a prior that someone can smell parkinson's as one in a million, or 10^-6. (Not very well argued, I admit.) P(data): This exact data's random occurrence probability is 1/2538. P(data|skill): The probability of the result, taking account that she has the skill, is 1 (this assumes she never errs). So we get P(skill|data) = P(data|skill) x P(skill) / P(data) P(skill) = 1 x 10^-6 / (1/2538) = 0.002538 Or 0.25 percent probability, based on this test, that she has the skill. Which is low. Intuitively, I would have expected the calculation to yield a much higher number. The prior was very low though. So I think the grandparent post has some merit. It can be argued that the claim is so extraordinary (the prior) that even twelve "coin tosses" guessed right in a row is more likely.
- biomcgary 11y agoHow many people claim they can smell Parkinson's? How many otherwise truthful, sane people have falsely made this claim? Perhaps a better approach to a prior would take into consideration that she claims that she can smell Parkinson's and her reputation as a truthful, sane person. My prior wouldn't be less that 0.1.
- Gravityloss 11y agoThat's a good point. On the other hand, if it was common for people (one in a thousand) to smell Parkinson's, somebody would have come forward 200 years ago? A doctor or nurse, perhaps. So, on population level it should be extremely rare. Of course, she is not a person picked at random, we should look at the population of people claiming to have done these sort of things already on their own. This population would be expected to contain a large portion of people with mental issues and charlatans trying to gain some financial benefit. If she doesn't have a history of either, then the prior jumps up to a very high level already. It is not very likely for a normal person to claim this sort of thing, unless they already have good evidence by themselves already.
- codeonfire 11y agoSo, with no scientific basis at all you believe there is a 10% chance that people can detect disease by smell, something that has AFAIK never been proven for any disease? We don't go to the doctor and have him or her smell our armpits. Do you use a psychic? What we have here is an organization that is basing their research funding on math tricks that I, ten years out of undergrad, maybe didn't remember exactly as it was characterized but was able to see through.
- adenadel 11y agoThe prior in this case isn't for people in general, it is for this person.
- KingMob 11y agoYou may want to revisit your stats, since there's no "math tricks" here. Even if you assume she knew that some sizable portion of the shirts came from AD patients, the p-val is quite low. If you assume every shirt was independent, so there's no knowledge to gained by knowing how many other shirts she classified as AD, the p-val is ludicrously low. And if you go Bayesian, no matter how you slice the prior probabilities, it's still low.