3 ms·
Why does strict falsifiability not work in social sciences? You just need to state your theories better if you can otherwise find counterexamples easily. Physic
by adrianN 9y ago
Why does strict falsifiability not work in social sciences? You just need to state your theories better if you can otherwise find counterexamples easily. Physicists don't say "smash these two particles together and you'll see a Higgs Boson", they have sufficiently nuanced theories that sifting through petabytes of data to find what you claim exists is justified.
- onli 9y agoIt's about the problems you can study. Take the Cornell Food Lab as example. One of the examples was that people will eat less sweets if they are stashed away and not fully visible on a table. It's interesting and it might very well be true, overall. But it is absurdly hard to know for sure. For one, devising an experiment for this is very hard. But the main problem is that you will absolutely find at least one person that eats more sweets when they are stashed away. So, the theory is wrong? Not really. It might be an invalid theory though. But if you think that, there are very few things those fields could study. I'd say there were no use for them. > they have sufficiently nuanced theories that sifting through petabytes of data to find what you claim exists is justified. That does not sound like searching for falsifiability to me. However, it sounds like the workaround I also tried: Backing a theory - that expects an overall result, not to be true for each individual - up with as much data as possible so one can reasonable assume it is true. But that's not really the correct approach. No, for something like the Higg Boson they try to see it or its effects (and if they were not to see it in the right circumstances, the theory were false). Might be a bad example though given how it touches physicists theory building.
- marcus_holmes 9y agoIs a theory that is true only part of the time actually any use to anyone? For example, your example. I might be the guy who eats more sweets when they're hidden. I go to my psych to talk about my sweet problem. The psych says "it's a well-studied phenomenon that you will eat less sweets if they're hidden". I hide my sweets. Boom, I eat more. What happens then? We know there's a huge variety in humans. But statistics weeds them out and talks about "the average human". Which is great for statistics and researchers. But since there's no such thing as the average human, how does this actually help us?
- upvotinglurker 9y agoIf, say, 95% of people tend to eat less sweets when they're hidden, it's worth trying the method first (then discontinuing it if it you turn out to be one of the 5%). Is a drug that cures most, but not all, instances of a specific infection useless?
- jamii 9y ago> Why does strict falsifiability not work in social sciences? Theories in physics provide specific numerical predictions. Theories in social psychology provide predictions like 'X is correlated with Y' which is very difficult to falsify because in practice everything is correlated with everything else to some degree. Null hypothesis significance testing is not the same as Popperian falsification either - it attempts to falsify the null hypothesis rather than the theory in question, and in the social sciences the null hypothesis is almost never strictly true. Meehl was talking about this as far back as 1990: > Null hypothesis testing of correlational predictions from weak substantive theories in soft psychology is subject to the influence of ten obfuscating factors whose effects are usually (1) sizeable, (2) opposed, (3) variable, and (4) unknown https://meehl.dl.umn.edu/sites/g/files/pua1696/f/144whysummaries.pdf https://meehl.dl.umn.edu/sites/g/files/pua1696/f/144whysumma... The consensus among folk who care about the problem seems to be that we should move from significance testing to predicting and estimating effect sizes. And then of course on top of that we still have to deal with publication bias, HARKing, researcher degrees of freedom etc.