3 ms·
Your "other extreme" story is basically an experiment--you're gathering a data set to test a proposition, so you have taken steps to ensure that the data set is
by snowwrestler 13y ago
Your "other extreme" story is basically an experiment--you're gathering a data set to test a proposition, so you have taken steps to ensure that the data set is representative for the proposition you're testing.
But if you don't know in advance what you're looking for, you don't know how to control the data set to ensure it is representative.
I could give you a data set of 1,000 recent lottery winners, and you would find that they are all named Ralph. But you might not know that I assembled the data set by looking for lottery winners named Ralph. You'll find a super-strong correlation, but be missing the context that would disqualify it as causal. You'd only find that out if you asked me how the data set was assembled...only at this point are you starting to pursue scientific knowledge.
You can't trust human perceptions of correlations to be representative of reality. That's the reason the scientific method was developed in the first place.
- deleted 13y ago[deleted]