3 ms·
Why not point to actual flaws in the methodology then? It’s a really interesting a very hard to run piece of research. Inevitably it will be flawed because tigh
by bigfudge 3y ago
Why not point to actual flaws in the methodology then? It’s a really interesting a very hard to run piece of research. Inevitably it will be flawed because tight real world experiments in economics are hard/impossible.
- Aloisius 3y agoI mean... there are basically no robustness checks.They only had a pre- and post-intervention comparisons with no random comparison group for a counterfactual. They asked retrospective questions. There are multiple poorly documented interventions. The analysis of the non-positive responses is extremely limited and what does exist draws conclusions that reek of confirmation bias. Their response rate for surveys appears to be crap which brings up questions of sampling bias. There is a strong appearance of cherry-picking. The descriptive statistics are extremely lacking - no confidence intervals, standard deviation, etc. - giving an appearance of p-hacking.