3 ms·

There are two possible dangers that you can fall into with science. One is to assume a conclusion with such force that it causes you to avoid certain questions

There are two possible dangers that you can fall into with science. One is to assume a conclusion with such force that it causes you to avoid certain questions or to suppress certain research. The other danger is to be so fascinated with doubt or so averse to a particular outcome that you ignore consensus, and place less weight than you should on the obvious conclusion that research is pointing to (and yes, I think the author is guilty of this). I have been hearing for a long time about how scientists are scared to question climate change, or gender differences between men and women. From what I've seen, the reality is that there are pretty clear conclusions that we can draw in those areas: that climate change is human-caused and dangerous, and that purely biological, mental differences between men and women are usually overstated. Frankly, I don't think that there's a particularly strong culture in science that is scared to ask those questions, and while cancel culture is a real thing, I don't think it's a real problem here. I do think there's a culture at the edge of science that doesn't like the answers researchers have found, and that is aggressively underestating the degree of confidence in those answers in the hopes that certain debates can be prolonged forever rather than used to influence policy changes right now. In other words, pervasive doubt can be just as dangerous and just as politically motivated as pervasive certainty. There are certain topics (such as climate change) where we effectively know the right answer. Of course we never reach 100% certainty, of course there are areas where we want to learn more, but we're a heck of a lot closer to 100% certainty than we are to 50% certainty. Because of that, some of the taboos you notice on the far-edges of the scientific community are actually justifiable defensive measures -- because running the clock down while introducing impossible standards of certainty is an effective strategy to circumvent scientific and social progress. We saw this happen with the sugar industry, we saw it happen with the tobacco industry, we saw it happen with race science, and we're seeing it happen today with gender studies, climate science, and anti-vaxers. If you were to look at the subjects I just listed to pick out a common theme or lesson, I would say that it is, 'beware isolated demands for scientific rigor, particularly when those demands are selectively applied in ways that benefit a political or socioeconomic status quo.'

mikedilger 7y ago
Scientific and social progress should continue with the near certainties we already have -- I think we are in agreement here. So long as we don't cancel contrarian scientists. We need to accept their long-shot research and be grateful for it, because we cannot predict ahead of time which one of them will turn out to be correct, as long as they couch their statements when they present them publicly. As a defender of free speech, I think that if some people want to believe in the long shots, they are making that ill-advised decision for themselves. When it comes to anti-vaxxers, they shouldn't have that choice as the effect is upon all of us. If a voting majority choose to believe the ill-advised long shot research then something is definitely broken, but it's not the existence of long-shot research. I won't pretend to know what that 'something' is.
thu2111 7y ago
From what I've seen, the reality is that there are pretty clear conclusions that we can draw in those areas The problem is this is circular: you reached your conclusions based on the output of the academic system (presumably). I used to think like this, that if most scientists agreed on something it was very likely to be true, that mistakes by whole fields were exceptionally rare and remarkable events, and that groupthink wasn't very powerful. Over the years I've been faced with evidence that I was wrong about those things, over and over again. Now I think if most scientists agree on a topic where you can't run extremely rigorous experiments then it's quite likely to be wrong, that mistakes by whole fields are very common and groupthink is extremely powerful. I do think there's a culture at the edge of science ... Science is almost entirely funded by governments. In some fields there's more diversity than others, but it's notable that the fields that seem to have the biggest problems and most controversies attached are the ones where there's little private sector involvement. If groupthink sets in, and due to the lack of any feedback loops from outside the academic system that is clearly a problem in academia, then almost by definition anything that's taboo will be at the "edge of science" even if it's right.
- Hercuros 7y ago
  I think the answer to this is not to start having general feelings of doubt about generally accepted conclusions in science. Rather, we need to be much more specific about where we think that groupthink is playing a role, looking at things on a case-by-case basis, rather than casting doubt on everything without justification. We also need to be extra careful with accusations about groupthink in fields where there is a political or economic motivation for making such accusations.
- danShumway 7y ago
  Maybe background plays a role here. My perspective is that I used to think like you growing up as a Creationist, and I can't see a major difference between the arguments OP is making and the arguments that were made to me by members of my church. I used to be highly dismissive of group consensus, I used to say that if you couldn't explain your point in a way that convinced me in specific, that I didn't care how many people agreed with you. I now think that consensus is an important metric that should be at least considered, particularly in areas where I am not an expert. Of course, we've seen areas where the broader scientific community was wrong. Before race science became a fringe argument used by fringe segregationists, it was a generally accepted conclusion. But again, underconfidence is just as dangerous as overconfidence. You can't pick one, you have to reject both. > you reached your conclusions based on the output of the academic system (presumably). At the end of the day I have to base my conclusions on something, and I think basing them on scientific output is a better place to start than basing them on ideology. Even from the much more subjective metric of "do I trust the communities who argue for this", climate-science doubters and gender-science doubters don't come out looking well. During the early rise of neural networks, where consensus was that this was extremely promising for AGI, I could find neutral, intelligent people that I respected who disagreed with that conclusion. That made me feel much more confident rejecting the general consensus myself. On the subject of gender-science, I can't find the same number of quality defectors. To me, the people saying that race/gender are heavily tied to IQ look a lot like Creationists, and I ain't getting pulled into that trap again.
turk73 7y ago
You're wrong. Just because 1,000 scientists believe climate change is "human caused" doesn't require it to be true at all. It could very well be related to solar input and nothing else, for example, or even more likely, our models are simply crap. These days, researchers compete for funding and funding is political. You must be a leftist to get funding. They punish all others because "social justice." We most definitely don't know the right answer and yet you believe something simply because it's been reinforced. Another word for that is propaganda. You are the victim of propaganda. At one time everyone believed that the sun and planets rotated around Earth. Only one guy stood up and said it was bullshit and he nearly got himself excommunicated for his sin.

mikedilger 7y ago

Scientific and social progress should continue with the near certainties we already have -- I think we are in agreement here. So long as we don't cancel contrarian scientists. We need to accept their long-shot research and be grateful for it, because we cannot predict ahead of time which one of them will turn out to be correct, as long as they couch their statements when they present them publicly. As a defender of free speech, I think that if some people want to believe in the long shots, they are making that ill-advised decision for themselves. When it comes to anti-vaxxers, they shouldn't have that choice as the effect is upon all of us. If a voting majority choose to believe the ill-advised long shot research then something is definitely broken, but it's not the existence of long-shot research. I won't pretend to know what that 'something' is.

thu2111 7y ago

From what I've seen, the reality is that there are pretty clear conclusions that we can draw in those areas The problem is this is circular: you reached your conclusions based on the output of the academic system (presumably). I used to think like this, that if most scientists agreed on something it was very likely to be true, that mistakes by whole fields were exceptionally rare and remarkable events, and that groupthink wasn't very powerful. Over the years I've been faced with evidence that I was wrong about those things, over and over again. Now I think if most scientists agree on a topic where you can't run extremely rigorous experiments then it's quite likely to be wrong, that mistakes by whole fields are very common and groupthink is extremely powerful. I do think there's a culture at the edge of science ... Science is almost entirely funded by governments. In some fields there's more diversity than others, but it's notable that the fields that seem to have the biggest problems and most controversies attached are the ones where there's little private sector involvement. If groupthink sets in, and due to the lack of any feedback loops from outside the academic system that is clearly a problem in academia, then almost by definition anything that's taboo will be at the "edge of science" even if it's right.

Hercuros 7y ago
I think the answer to this is not to start having general feelings of doubt about generally accepted conclusions in science. Rather, we need to be much more specific about where we think that groupthink is playing a role, looking at things on a case-by-case basis, rather than casting doubt on everything without justification. We also need to be extra careful with accusations about groupthink in fields where there is a political or economic motivation for making such accusations.
danShumway 7y ago
Maybe background plays a role here. My perspective is that I used to think like you growing up as a Creationist, and I can't see a major difference between the arguments OP is making and the arguments that were made to me by members of my church. I used to be highly dismissive of group consensus, I used to say that if you couldn't explain your point in a way that convinced me in specific, that I didn't care how many people agreed with you. I now think that consensus is an important metric that should be at least considered, particularly in areas where I am not an expert. Of course, we've seen areas where the broader scientific community was wrong. Before race science became a fringe argument used by fringe segregationists, it was a generally accepted conclusion. But again, underconfidence is just as dangerous as overconfidence. You can't pick one, you have to reject both. > you reached your conclusions based on the output of the academic system (presumably). At the end of the day I have to base my conclusions on something, and I think basing them on scientific output is a better place to start than basing them on ideology. Even from the much more subjective metric of "do I trust the communities who argue for this", climate-science doubters and gender-science doubters don't come out looking well. During the early rise of neural networks, where consensus was that this was extremely promising for AGI, I could find neutral, intelligent people that I respected who disagreed with that conclusion. That made me feel much more confident rejecting the general consensus myself. On the subject of gender-science, I can't find the same number of quality defectors. To me, the people saying that race/gender are heavily tied to IQ look a lot like Creationists, and I ain't getting pulled into that trap again.

turk73 7y ago

You're wrong. Just because 1,000 scientists believe climate change is "human caused" doesn't require it to be true at all. It could very well be related to solar input and nothing else, for example, or even more likely, our models are simply crap. These days, researchers compete for funding and funding is political. You must be a leftist to get funding. They punish all others because "social justice." We most definitely don't know the right answer and yet you believe something simply because it's been reinforced. Another word for that is propaganda. You are the victim of propaganda. At one time everyone believed that the sun and planets rotated around Earth. Only one guy stood up and said it was bullshit and he nearly got himself excommunicated for his sin.