3 ms·
One possibility that came to mind when I read his post that harmonizes both your point and his data is that the studies that have been done would almost certain
by jerf 9y ago
One possibility that came to mind when I read his post that harmonizes both your point and his data is that the studies that have been done would almost certainly have been looking at very broad effects, on very broad populations, which results in a very averaged, fuzzy view of things. That is not a criticism, because it is a priori both plausible that there will be some effect at that scale, and that there won't be, so it's a worthy test.
But it is also possible that while broadly speaking birth order doesn't have any significant effects on things, when you go out to a population as niche as "people who read SSC and like it enough to fill out a form for 15-30 minutes just because Scott asked them too" and you slice the n-dimensional space in question with that much precision, that you will get a very, very particular slice of the world in which there are birth order effects.
This would imply that there are birth order effects, but that in general they are too weak to be picked up by a general-purpose study. However, perhaps if you magnify them in such a precise way you can see them, even though they are small. "Member of the SSC community" is a very information-rich cut of the general population and it would not be a surprise to see that poking out of the stats in many other ways.
Statistics being what they are, I believe it is completely possible for both "Birth order has no significant impact on whether you will show up in SSC's community" and "Given membership within SSC's community, birth order effects can be witnessed" to be simultaneously statistically true. Previous studies showing birth order to not matter would be testing a hypothesis much closer to the first one, Scott is obviously testing the latter.
This is merely a hypothesis that is not very complicated (in Occam's Razor terms, given the fact that "everything sorta correlates to everything" is a basic fact of the world we live in and thus using that does not really count as "multiplying entities") and fits both the facts, but not one I am claiming is certain to be true. A lot more analysis would have to be done, to a degree of rigor I doubt anyone is going to perform since nobody has the full picture and the effort to obtain the full picture is likely larger than the payoff. So let it be clear that I'm just spitballing, and aware of the fact that I'm just spitballing.
- theptip 9y agoThis hypothesis could well be true, but it's somewhat difficult to falsify; you can always posit an effect that only appears in the small statistically-underpowered cohort that Scott sampled, and which would be swamped by the average of the population as you start to increase the sample size to verify the effect. As a counterpoint, Scott went the other direction in his post, arguing that the true effect was more general, but the metrics previous academics used was broken, and therefore undersold the strength of the effect they were detecting: > I think the most likely explanation is that tests for Openness have limited validity, which makes the correlation look smaller than it really is. If being an eldest sibling increases true underlying Openness by a lot, but your score on psychometric tests for Openness only correlates modestly with true underlying Openness, that would look like being an eldest sibling only increasing test-measured-Openness a little bit. It's simple to falsify this (though it requires some work); just do more experiments on the general population using the metric that Scott likes [1], and see if that detects a stronger birth-order effect. [1]: https://www.researchgate.net/publication/230787941_Construct_validation_using_multitrait-multimethod-twin_data_The_case_of_a_General_Factor_of_Personality https://www.researchgate.net/publication/230787941_Construct...