3 ms·

Again, the issue isn't one of methodology or technology. It's inherent to the research process. Let's do a thought experiment and imagine two identical researc

Again, the issue isn't one of methodology or technology. It's inherent to the research process. Let's do a thought experiment and imagine two identical research projects done in parallel universes. Everything is the same between these two universes except that the researchers are different people. In some fields, you'd probably expect the results to be the same. The researcher shouldn't affect objective results after all. In a social science setting, the results may not be the same even if both researchers used exactly the same research design on exactly the same subjects at exactly the same point in their lives. It should be very clear by this point in the thought experiment that "objectivity" is not really possible under those conditions. You need some theory to deal with this issue, but honestly it's manageable for the most part. Now, the real kicker is that researchers affect their research way more than this. They actually design the project and constantly make decisions / interpretations throughout. These decisions and interpretations are subjective by definition. Even if we had a magical way to get objective data, are you really still willing to call it objective after a dirty, subjective human has so much as looked at it, let alone done the sort of filtering and interpretation inherent to academic research in all fields?

malvosenior 7y ago
I think it says a lot about the value of the social “sciences” that they can’t be backed by data and aren’t reproducible. It seems that maybe they can be data driven but the results aren’t what the traditional practitioners of the field like to see. I think we’ll see the role they historically played replaced by machine learning which has more predictive power simply because it’s backed by reality.
naasking 7y ago
> The researcher shouldn't affect objective results after all. In a social science setting, the results may not be the same even if both researchers used exactly the same research design on exactly the same subjects at exactly the same point in their lives. This is true of physics as well. Measurements in quantum experiments are contextual, in that the experimental setup interferes with system being measured. Measurements conform to statistical distributions. The difference is that physicists took the time to quantify how measurements influence the system, thus generating a practical theory. It's not clear to me that something similar couldn't be done here, even if human systems are in a sense, messier. In fact, it's already been done to some extent because we clearly know how the phrasing of some questions influence the answers. We also know from tragedies of justice [1] how important this subject is. Replication and a culture that encourages publishing negative results should be prerequisites for any field to qualify as a science. [1] https://en.m.wikipedia.org/wiki/Day-care_sex-abuse_hysteria https://en.m.wikipedia.org/wiki/Day-care_sex-abuse_hysteria
choeger 7y ago
> It should be very clear by this point in the thought experiment that "objectivity" is not really possible under those conditions. You need some theory to deal with this issue, but honestly it's manageable for the most part. Tbh, That sounds like a lame excuse. The logical conclusion is that science done that way will never produce truth[1]. In consequence we should stop listening to such "scientists". [1] As in "can be reproduced and likely gives the same result"

malvosenior 7y ago

I think it says a lot about the value of the social “sciences” that they can’t be backed by data and aren’t reproducible. It seems that maybe they can be data driven but the results aren’t what the traditional practitioners of the field like to see. I think we’ll see the role they historically played replaced by machine learning which has more predictive power simply because it’s backed by reality.

naasking 7y ago

> The researcher shouldn't affect objective results after all. In a social science setting, the results may not be the same even if both researchers used exactly the same research design on exactly the same subjects at exactly the same point in their lives. This is true of physics as well. Measurements in quantum experiments are contextual, in that the experimental setup interferes with system being measured. Measurements conform to statistical distributions. The difference is that physicists took the time to quantify how measurements influence the system, thus generating a practical theory. It's not clear to me that something similar couldn't be done here, even if human systems are in a sense, messier. In fact, it's already been done to some extent because we clearly know how the phrasing of some questions influence the answers. We also know from tragedies of justice [1] how important this subject is. Replication and a culture that encourages publishing negative results should be prerequisites for any field to qualify as a science. [1] https://en.m.wikipedia.org/wiki/Day-care_sex-abuse_hysteria https://en.m.wikipedia.org/wiki/Day-care_sex-abuse_hysteria

choeger 7y ago

> It should be very clear by this point in the thought experiment that "objectivity" is not really possible under those conditions. You need some theory to deal with this issue, but honestly it's manageable for the most part. Tbh, That sounds like a lame excuse. The logical conclusion is that science done that way will never produce truth[1]. In consequence we should stop listening to such "scientists". [1] As in "can be reproduced and likely gives the same result"