3 ms·
https://nulib.github.io/moderndive_book/7-causality.html https://nulib.github.io/moderndive_book/7-causality.html https://bolt.mph.ufl.edu/6050-6052/unit-2/cau
by Spivak 4y ago
https://nulib.github.io/moderndive_book/7-causality.html https://nulib.github.io/moderndive_book/7-causality.html
https://bolt.mph.ufl.edu/6050-6052/unit-2/causation-and-experiments/ https://bolt.mph.ufl.edu/6050-6052/unit-2/causation-and-expe...
https://towardsdatascience.com/establishing-causality-part-1-49cb9230884c https://towardsdatascience.com/establishing-causality-part-1...
https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6235704/ https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6235704/
https://escholarship.org/uc/item/42v4w8k1 https://escholarship.org/uc/item/42v4w8k1
http://ippsr.msu.edu/public-policy/michigan-wonk-blog/randomized-controlled-trials-public-policy http://ippsr.msu.edu/public-policy/michigan-wonk-blog/random...
https://www.cs.cornell.edu/courses/cs1380/2018sp/textbook/chapters/16/3/causality.html https://www.cs.cornell.edu/courses/cs1380/2018sp/textbook/ch...
I’ll leave open the possibility that it’s everyone else that’s wrong but RCTs are used to establish causality and are as much “proof” as you’re gonna get in science.
Hell ya know what I’ll just let the actual paper explain it.
> The second, more important advantage of randomized field experiments is that they can distinguish causation from correlation. The ability to prove causal relationships derives from the combination of two characteristics. The first is having a control group, that is, a group unaffected by the intervention (in our case, publication of a Wikipedia article on the topic) that can be used as a counterfactual to estimate the size of causal effects. The second is randomization, that is, random assignment into the control and intervention groups. With sufficient data and a sound experimental design, the experiment can reduce the probability of being misled by correlation or noise to whatever arbitrarily small value is desired.
- pdonis 4y ago> RCTs are used to establish causality and are as much “proof” as you’re gonna get in science. No, they're not. The real "gold standard" in science--the standard that prevails in, for example, physics or chemistry--is a controlled experiment. Not just a "randomized controlled trial", but a controlled experiment, where you can actually dictate exactly what state the things you are going to experiment on start out in. And the eventual output of controlled experiments is a predictive model--a model that can predict, accurately, what will happen if you run further experiments. That is what it takes to truly "establish causality". But in most other domains, including the one under study here, controlled experiments simply cannot be done and predictive models with any kind of accuracy simply don't exist. The correct response to that unfortunate fact is to realize that we can never achieve the same level of confidence in these other domains as we can in domains like physics or chemistry where we can do controlled experiments. Unfortunately, the response "science" has settled on instead is to pretend that it doesn't matter--that because we can't do controlled experiments in these other domains, the universe will somehow magically lower its standards of what it takes to achieve the level of confidence we want. But the universe doesn't care what we can or can't achieve.
- asdff 4y agoThey did do a controlled experiment here. They had articles in a treatment group and articles in a controlled group. What are the shortcomings you have in mind when you say that "controlled experiments simply cannot be done" when it appears that they have done a controlled experiment?
- DiggyJohnson 4y agoBecause the experiment itself isn’t closed.
- asdff 4y agoWhat do you mean by closed?
- pdonis 4y agoI think he means that you can't isolate and control the environment of humans the way that physicists or chemists can isolate and control the environment of particles or molecules that they are experimenting on. That's an additional issue to the one I raised in another response just now in this subthread.
- asdff 4y agoYou can when you have many samples divided into treatment and control groups that are otherwise identical, that overcomes any biases or confounding variables that might be influencing the design and ensures that what you are seeing is causal. How much are physicist or chemists really controlling in the lab setting? There could be plenty of confounding variables in their experiments too. Maybe "RT" in this lab for that publication for that experiment is actually 75*F and its 71*F in your lab, or you are at different elevations. Maybe no one calibrated the instruments for years. Maybe the reagent wasn't fresh and absorbed too much moisture or oxygen from the room. Maybe an undergrad dropped the balance on the floor and was afraid to tell anyone. To overcome those potential confounding variables and other biases, chemists and physicists often turn to the exact same statistical tests being employed by people in the social sciences. Technical replicates are the norm in hard scientific experimental design because of how many biases could be present in the laboratory. It's a chaotic environment. Good experimental design builds robustness no matter what your topic is.