7 ms·
Why Facts Don't Change Our Minds
- OmarShehata 2y agoThere's an extremely simple answer to this: humans don't actually change their minds rationally. People arrive at most beliefs emotionally. The reason the people DO NOT change their mind when told that "the scores were fake" is because they felt good when told the scores showed that they were correct, and that reinforced their own belief about their skill. When told "actually the scores were made up" this is new evidence but it doesn't change the underlying narrative (they already believed they were good, and that was emotionally reinforced). If you keep this in mind a lot of human behavior becomes much more predictable
- armada651 2y agoThat doesn't entirely explain why the group with lower scores still thought they did worse than average. Why would they reinforce a false narrative that made them feel bad? It might be explained that the mind will ignore evidence that doesn't confirm their emotions regardless of whether those emotions made them feel better or worse. That would explain things like imposter syndrome, where people continuously ignore evidence that they are doing well because it doesn't confirm their lack of confidence in their skills.
- AndyNemmity 2y agoYou just rationally explained a logical issue in the parent's post. Will the parent change their mind, or will they reinforce the positive narrative that they were explaining to everyone how it worked override it?
- vannevar 2y agoThe article doesn't provide details, but it would be interesting to know what percentage of the test subjects, if any, did in fact change their view in light of new evidence. Surely some people are more rational than others.
- dymk 2y agoWhy do you assume some people are more rational than others?
- madaxe_again 2y agoIt’s a reasonable assumption. Some people are shorter than others. Also, quite a bit of what we class as mental illness seems to be an overabundance of rationality. The existential dread of the depressed. The questioning of societal norms by autists. Neither are wrong, but both are socially dysfunctional. Then, there are those of us who just can’t hack belief. “Just trust me, it’s true” was never an acceptable answer, and so I was a kid full of “why”, and am the same as an adult. If it can’t be explained, rationally and coherently within the context of everything else, it just gets put in a “maybe” pigeonhole and awaits further evidence or information. I form hypotheses, but they are not precious to me - I suppose for me because my identity isn’t tied to any concept in particular, and I’m quite acceptant of myself as a remarkable yet purposeless molecular Heath Robinson contraption. I also doubt that I am alone. Am I perfectly rational? Lord, no. Do I think I manage a higher level of rationality than most, and have an… “unusual” life to show for it? Sure.
- shepherdjerred 2y agoThere's no such thing as a standard human. You can't find one trait or measure that is the same for all humans. Everyone is different in every way, though the difference isn't always enough to matter.
- FatalLogic 2y agoMaybe you can find the answer to your question in the original papers? These are probably the publications: Ross, L., Lepper, M.R. and Hubbard, M. (1975) Perseverance in Self-Perception and Social Perception: Biased Attributional Processes in the Debriefing Paradigm. Journal of Personality and Social Psychology, 32, 880-892. https://sci-hub.st/https://doi.org/10.1037/0022-3514.32.5.880 https://sci-hub.st/https://doi.org/10.1037/0022-3514.32.5.88... Anderson, C.A., Lepper, M.R., & Ross, L. (1980). The perseverance of social theories: The role of explanation in the persistence of discredited information. Journal of Personality and Social Psychology, 39, 1037-1049. https://sci-hub.st/https://doi.org/10.1037/h0077720 https://sci-hub.st/https://doi.org/10.1037/h0077720
- omoikane 2y agoThis article is a collection of interesting experiments, but it didn't quite explain the "why" in the title for me. Maybe the point is simply that we humans are naturally inclined to make our beliefs persistent. I think the proper term for this is "backfire effect": https://en.wikipedia.org/wiki/Belief_perseverance https://en.wikipedia.org/wiki/Belief_perseverance Which I learned via this comic: https://theoatmeal.com/comics/believe https://theoatmeal.com/comics/believe
- ranger_danger 2y agoI understood their "why" to be more of an evolutionary thing... "Reason is an adaptation to the hypersocial niche humans have evolved for themselves". They also seem to cite confirmation bias as part of it as well.
- lylejantzi3rd 2y ago"New discoveries." Aristotle knew this 2000+ years ago. https://classics.mit.edu/Aristotle/rhetoric.1.i.html https://classics.mit.edu/Aristotle/rhetoric.1.i.html
- PaulKeeble 2y agoAs is often said you cannot reason someone out of a position they didn't reason themselves into. It also goes to show the immense danger in allowing authorities to lie and build a straw man because this leads to permenant damage to the thinking of the people who believed it even when they know later it was a lie. Adopting scientific thinking and evidence is significantly harder work which combined with the bias of prior experience makes it very hard indeed for new evidence to change existing minds. We know this as science progressing one dead person at a time, even scientists can not adopt new thinking we have to wait until they die while training all new people with the new understanding. We have deep flaws as a species.
- rgbswan 2y ago[dead]
- horeszko 2y ago>"We know this as science progressing one dead person at a time, even scientists can not adopt new thinking we have to wait until they die while training all new people with the new understanding. We have deep flaws as a species." I've always considered this an advantage. The previous generation provides stability by sticking to what it knows and believes and the next generation adapts society to new understanding and circumstances. On aggregate this provides a measured response to changes in society and understanding.
- nine_k 2y agoIt may also be painful to watch and experience if this paradigm shift has real-world implications aka if it matters at all. It took a long time before the community of doctors accepted the experimentally proven concept of washing hands and instruments before doing something to a patient, e.g. a surgery. While it may have provided some nice stability, it also prolonged and produced quite some suffering.
- PaulKeeble 2y agoEven now its a problem getting healthcare workers to wash their hands, its a constant task of enforcement. We have had good and increasing evidence for the air borne spread of diseases since the early 20th century and yet even now airborne spread of viruses via aerosol is rejected by most. We have experiments showing that Covid and other viruses spread airborne in small 1-3 micrometre aerosoles and confirmed transit over quite large distances on the wind. We also have experimental evidence that it can survive in the air for many hours. Yet the WHO still has not accepted that viruses spread this way and indeed many governments are rejecting it as well. This is a Semmelweis moment happening currently and its not just one scientist being rejected its hundreds all coming at the problem from different directions finding the same thing.
- ranger_danger 2y ago"As a rule, strong feelings about issues do not emerge from deep understanding." Mind = blown. Also relevant: https://www.youtube.com/watch?v=bX3EZCVj2XA&t=289s https://www.youtube.com/watch?v=bX3EZCVj2XA&t=289s
- Animats 2y agoThe researchers mostly demonstrated that if you lie to people, you can confuse them. This is not much of a result. They're not really doing the experiment they claim they are doing. They need an experimental design that doesn't involve lying.
- pessimizer 2y ago> The researchers mostly demonstrated that if you lie to people, you can confuse them. Pretty sure it was more detailed than that. > They need an experimental design that doesn't involve lying. Why?
- Animats 2y agoBecause, having been lied to once, people will assume that it's likely that they are still being lied to.
- rmunn 2y agoThis is the biggest flaw in the New Yorker article. It assumes that the rational thing to do, upon being told you'd been lied to, is to re-evaluate your assumptions while assuming that THIS time the researchers are telling you the truth. When in fact, it's far more rational, when you discover that someone has lied to you, to start mistrusting ANY information from that source. Including the statement, "I lied earlier, here's what's really going on." So even though the participants had no basis for persisting in their belief that they'd done well or poorly, they also had no basis for changing their belief. Because why would you trust the word of an admitted liar? And so, in the absence of any reason to change their previously-formed assumptions, they persisted in them. The New Yorker article thinks that that is irrational, but for that to be irrational, you have to assume that taking the word of a known liar is rational behavior. I, for one, don't agree with that premise.
- intended 2y agoThe test was to check if people changed their minds. People were told they were lied to, it still didn’t change their minds.
- rendall 2y agohttps://archive.is/jGOUf https://archive.is/jGOUf
- recursivedoubts 2y agoFacts don't change our minds. Natural selection is a thing. The Thing, by many accounts. Hmm.
- scotty79 2y ago> any graduate student with a clipboard can demonstrate that reasonable-seeming people are often totally irrational And yet, mainstream theories of economy assume that individuals are reasonable actors successfully and efficiently acting in their own self-interest.
- nitwit005 2y agoYou're going to struggle to find any economist who agrees with the concept that everyone is acting rationally.
- andrewflnr 2y agoSomewhat famously, people do get more rational when money is on the line. Not homo economicus rational, but a little more connected to reality. Usually this is interpreted cynically.
- mr_toad 2y ago> And yet, mainstream theories of economy assume that individuals are reasonable actors successfully and efficiently acting in their own self-interest. They really don’t. In the context of this discussion it’s quite ironic that this myth is so widespread.
- scotty79 2y agoThis myth is basically a tenet of popular capitalism. It's as spread as the belief in capitalism itself.
- titannet 2y agoEven the US is fairly far away from theoretical capitalism.. "No barriers to market entry" - ever seen that one in practice?
- scotty79 2y agoI think in US barriers of entry are lower. I've seen a video about a software developer in US that lived in the neighborhood where garbage collection company wanted to charge extra for getting out of the truck and emptying the trash bins. This guy basically told their neighbors that he can provide same service they used to have at the same rate, collected orders and bought random used "smaller" (but still quite large) garbage truck with robotic hand to pick up the bins. In Europe without special driving license for trucks he wouldn't be able to drive it (it weighed above 3.5T). I'm assuming other kinds of licenses are also required to ensure the collected garbage is disposed of properly. In many places garbage collection is a service that's ordered through the local government so that the prices can be kept similar for everybody so that people from remote places (who'd need to pay more for collection) won't just toss their garbage into the forests and such.
- joenot443 2y ago> As is often the case with psychological studies, the whole setup was a put-on. Do people who participate in psychological studies ever realize this is the case? Surely after the first time being misled by someone in a lab coat you'll be more skeptical the next time?
- erehweb 2y agoAt a seminar, the economist Binmore noted this as a problem - every psychological study from Milgram on has been a trick, and so subjects (undergraduates) are alert to this. He just wanted to study how markets / prices could form, if memory serves, but he could see students reading the instructions and trying to figure out where the trick was.
- hedvig23 2y agoI don't believe or value political polling in the same vein
- intended 2y agoPsych studies have to inform participants of the purpose of the test and debrief them if they want to survive ethics review. This can be a challenge, but does lead to many interesting workarounds. The original change blindness / door experiment conducted outside a lab setting didn’t get permission from participants before enacting the test. This had to be corrected, and subsequent tests needed participants to sign off before they could participate. If you know the experiment, you would assume that being informed of the experiment would not be conducive to the test. The researchers found a way to still create a workable experiment. Volunteers would be able to go to a kiosk to sign up. If they signed the release (? forget the name) form the kiosk attendant would duck down out of line of sight for a second to pick something up, and would be replaced by the accomplice. They would then direct the volunteer to the debriefing room.
- selcuka 2y ago> Surely after the first time being misled by someone in a lab coat you'll be more skeptical the next time? No, because facts won't change their mind.
- apollo_mojave 2y agoThis is why I think the study of logic and having fields where the culture generally agrees on "what counts" as good argumentation is really important. Does it solve these problems entirely? Certainly not. But look at, for example, the culture in the scientific community. From my outsider's perspective, it seems the scientific community has adopted a series of guardrails that generally prevent "bad" research from getting published. Famously, it doesn't always work, and I'm not ignorant to the latest series of scandals involving illegitmate journals, p-hacking, etc. But I think these tend to be the attention grabbing headlines, rather than the "norm." Glad to be challenged on that point. But to return to my initial idea: I do think that we can arm ourselves with certain principles that, if applied, will move us away from biased thinking. Simply being aware of "confirmation bias" and other psychological pitfalls might make us more capable of figuring out where we're going wrong. As the article notes, people are famously blind to their own errors, but quite good at pointing out others'. So it's not like it's impossible for us to become better and stronger thinkers. It just takes effort and some "meta-thinking" and I think some personal virtue and character to become better!
- mistermann 2y ago> From my outsider's perspective, it seems the scientific community has adopted a series of guardrails that generally prevent "bad" research from getting published. > But to return to my initial idea: I do think that we can arm ourselves with certain principles that, if applied, will move us away from biased thinking. Run the proposition that science has cast its net of expertise and authority a bit too broadly by the science crowd and see how that goes over. Or, pay attention going forward to what that crowd has to say about philosophy and other non-hard-science disciplines while reading your various socials.
- raxxorraxor 2y agoI think the mechanism in the scientific community that allows progress are just multiple perspectives. The version where there is one scientific authority that sets these guardrails is prone to fail and does that quite reliably. Different faculties have different requirements for their scientific work, but even here the established players often become a problem. The power of journals and their reputation can be detrimental, but as long as there is competition, it should work. I think some field are less vulnerable here than others. You cannot just deliver scientific work in sociology/political science. You will have to fight a lot of people who will disagree for ideological reasons. These are by nature distinct from discussion about what color some gluon needs to have in some theoretical particle, although you have entirely "people focused conflicts" here as well. But overall you should never put your belief in guardrails. They will be wrong and the next ostracized scientist was right in the end. The only relevant content is indeed the one in the scientific work itself. Whom you delegate them to evaluate them for you is a personal matter and no institution alone can take up this task.
- scotty79 2y agoIf you wonder in what kind of environment human "reason" possibly evolved read this commentary on the experience of a young woman kidnapped by a primitive society and her survival among them. https://woodfromeden.substack.com/p/the-survival-skills-of-helena-valero https://woodfromeden.substack.com/p/the-survival-skills-of-h... Having allegiance to truth rather than to people would be definitely a maladaptive trait.
- qazxcvbnmlp 2y agoFacts changing / not changing our mind will depend on what you define as a fact. Usually the nuance is that just because “someone” said that something is true, doesn’t make it automatically true. Most people will change an objectively held belief in light of tangible evidence. However; news, statistics and statements from other people are not inherently believable. Something we can see / smell / taste / hear / touch will absolutely change someone’s mind.
- nine_k 2y agoTo accept even tangible evidence, one needs to be prepared to change their opinion at all. Very often the opinion, and the worldview it buttresses, is too important for the comfort and confidence in the world to allow any evidence ruin it. Counterexamples would be rejected as rare deviations or observational errors. Systemic evidence would be written off as propaganda and gaslighting. Persuasion by close friends may even be seen as perfidy and an attempt to maliciously pull a leg. Sadly, the most correct model of the world is not necessarily a prerequisite for the best fitness and thus survival.
- intended 2y agoIn the article, people were critical about positions they themselves created though. There is a lot of weight being carried by “someone” and “tangible evidence”; based on that framing it’s possible that tangible evidence is only tangible if it is from the correct “someone”. Not sure if this what you wanted to say, but this seems to be the fundamental truth you are espousing. Vs “there is some set of facts that will change people minds.” People very much reject what they can see, smell, taste, hear and touch. The one thing that impacts such behavior is not facts, but people actually working on the problem (“what are the implications of your belief, what happens when this occurs? Etc.)
- foxglacier 2y agoCan you give examples of people rejecting what they see/touch/etc.? Or are they actually rejecting some other intangible information that's required to interpret those things in the "correct" way?
- bryan0 2y ago(2017)
- alanbernstein 2y agoEh, I'm pretty sure facts do change MY mind
- ninetyninenine 2y agoHere's a fact: You're utterly wrong and there's tons of scientific evidence behind this fact. Look! it's not changing your mind.
- amatecha 2y agoFirst, "citation needed", but also for me personally, I'm often totally undecided or otherwise un-committed to one view or another about something, because I sense my knowledge of that thing is minimal, or my only exposure to that thing is via hearsay and anecdotes etc. … so it remains in that unresolved state until I either gain more information or am forced to make a choice with incomplete info. I don't often see this approach from other people, for whatever reason.
- ninetyninenine 2y ago[dead]
- alanbernstein 2y agoCongratulations, you almost got the joke!
- ninetyninenine 2y agoBro, he’s not joking. If anything I’m joking a bit. You’re not getting it.
- alanbernstein 2y agoHe is me, and he was definitely joking
- Leary 2y agoBiased, or just Bayesian?
- gradschoolfail 2y agoWhen frustrated by this eternal verity, I remember the lesson of Gutei’s finger (a koan from Mumonkan) https://thedewdrop.org/2018/12/28/guteis-finger/ https://thedewdrop.org/2018/12/28/guteis-finger/
- hunglee2 2y agofacts themselves are fictions - they are only a description of memes which have achieved consensus. Persuasion is all about 'ambient propaganda' - just flood the information system with your memes-of-choice and we will come to accept them as true
- mattigames 2y agoI find this to be particularly true with modern feminists, I don't think they have ill intentions but as a group they see to suffer from overcorrection and start touching subjects outside their understanding, the abuse was clear on some subjects so they extrapolate those findings on everything else, if you show a modern feminist that most homeless and most suicides are overwhelmingly done by men any sort of rational discussion it's thrown out of the window, or correlations with poverty or any subject that isn't gender, pointing any of those correlations it's perceived as an attack and not any longer any intelectual pursuit, the tribalism kicks in and it's impossible to take it out.
- purplethinking 2y agoTrue for most people on the left today. For example, they don't like Elon Musks personality/politics (which is fine, very understandable), so they are completely unable to objectively evaluate his achievements. Because they don't like him, he must be stupid, and therefore they must find reasons to dismiss anything he's ever done. It's almost comical to watch. There is no amount of evidence that can change their mind. First hand accounts from the engineers working under him, multiple biographies, at least 5 companies worth more than a billion dollars, two in the hundreds of billions. But no, it's all luck or fraud. Maybe he's an evil Forrest Gump? Honestly, seeing this kind of brain rot is kind of radicalizing in itself. You start to question what other views you've adopted are just group think and emotional reactions.
- jasfi 2y agoDoes this explain some LLM behavior when they refuse to give up their position? I've heard about this and I've seen it myself. Not saying it's because of the architecture, but perhaps because of human conversations in the training data.
- jamesbrock 2y agoDavid Remnick’s New Yorker is not really in a position to scold other people about facts. Here is a fun exercise that David Remnick and other Americans can do to see if they can change their minds when presented with facts: https://benthamopen.com/contents/pdf/TOCPJ/TOCPJ-2-7.pdf https://benthamopen.com/contents/pdf/TOCPJ/TOCPJ-2-7.pdf
- NotGMan 2y ago>> If we all now dismiss as unconvincing any information that contradicts our opinion, you get, well, the Trump Administration. Confirmation bias much? Ironic? >> Of course, what’s hazardous is not being vaccinated; that’s why vaccines were created in the first place. “Immunization is one of the triumphs of modern medicine,” the Gormans note. But no matter how many scientific studies conclude that vaccines are safe, and that there’s no link between immunizations and autism, anti-vaxxers remain unmoved. There are very few studies for vaccines proving their safety, and even those few are only for a FEW vaccines. https://www.midwesterndoctor.com/p/the-hpv-vaccine-disaster-was-a-tes https://www.midwesterndoctor.com/p/the-hpv-vaccine-disaster-... https://x.com/ChrisMasterjohn/status/1664785355864719360 https://x.com/ChrisMasterjohn/status/1664785355864719360 Most vaccines that children are given have 0 long term safety studies.
- tim333 2y agoI was thinking they were oversimplifying a bit with "vaccines are safe" as the reality is they have some hazards but generally much less than the disease. But not always, for instance the Astra covid vaccine seemed to have worse effects than the risk of the illness in some young people and got discontinued for those for that reason. I'm not sure if over dumbing it down is a good idea.
- insightfulwhers 2y agoBecause facts have no bearing if people have different value systems. I'm not a woman and I don't have daughters. Do I care about abortion. No! Am I affected by H1B abuse by companies yes. Do I care about it yes. This is why facts don't change people's minds. Because everyone cares about different things.
- dctoedt 2y ago> I'm not a woman and I don't have daughters. Do I care about abortion. No! Empathy allows seeing things from others' perspective. Rational thinking allows looking ahead on the chess board. My kids are grown and gone but unlike some olds, I don't object one bit to paying taxes for public schools, in fact I vehemently object to across-the-board slashing of spending† on public schools because that way lies disaster. † which is a different issue than whether to cut particular programs, etc.
- tim333 2y ago>Respondents were so unsure of Ukraine’s location that the median guess was wrong by eighteen hundred miles... I wonder if the use of AI may help with these things - able to absorb a much larger quantity of facts about what's going on than your average voter but being easier to check for bias than typical news sources say.
- motiw 2y agoThe insights gained from artificial intelligence about neural networks can help explain why facts often fail to change our minds. Repeated exposure to certain messages strengthens the neural connections that support them, embedding these ideas deeply in our memory and influencing our perceptions and beliefs. As a result, when we encounter facts that contradict these established beliefs, the brain is less likely to integrate the new information. Instead, it relies on the well-worn pathways created by repeated messages, making it challenging to replace old beliefs with new facts. This process shows how repetition can entrench ideas, creating mental resistance to changing perspectives even when presented with solid evidence.
- QuantumGood 2y ago"Alternative facts" are a thing. of course. I've seen facts dismissed with "most of what you said is a lie" by people who believe what they are saying. My favorite is someone saying "if you're fine with the absolute shitshow of recent years you haven't been paying attention", i.e. Fox tells me everything sucks, I listen to a thousand hours of that, you make one short list of contradictory facts, and it looks to me like lies and nonsense.