6 ms·

I'd just like to reemphasize what conclusions you should and shouldn't draw from an experiment being invalidated. If an experiment is run that says the sky is b

I'd just like to reemphasize what conclusions you should and shouldn't draw from an experiment being invalidated. If an experiment is run that says the sky is blue, then its invalidation does not mean that the sky is not blue. It means we no longer have evidence for that conclusion. The correct answer then isn't the negation of the original study's conclusion. The correct conclusion is that we don't know or aren't sure. Likewise, if the SPE is invalid, it doesn't imply that average people aren't capable of horrific behavior - it simply means we have less evidence to determine that than we thought we did.

whiddershins 8y ago
Well, the message people got was that students who were knowingly participating in a college psych study became spontaneously sadistic within just a day or two. That feels intuitively ridiculous, and has no evidence I know of to support it, except this study.
- CamperBob2 8y ago
  The idea behind the study was to try to understand how an entire nation - Germany - could go berserk with hatred and sadism. Scientific or not, the burden of proof lies with those who dispute Zimbardo’s (and Milgram’s) findings, because they have been borne out so many times in so many different contexts. Their work has never been more relevant than it is now, as we witness the rise of Trumpism. What alternative explanations would you propose?
  - shkkmo 8y ago
    1) Milgram's and Zimbardo's findings are very different. Milgram's have been backed up by many replications and are often mis-understood. 2) We have both experimental and factual evidence that shows that Zimbardo's findings were lies. 3) The entire nation of Germany did not go berserk with hatred and sadism. 4) Name one instance where Zimbardo's findings have been born out is "so many different contexts"? The rise and success of Nazism (like most social movements, including 'Trumpism') was the result of a confluence of a number of factors. To pretend that it was just "how people are" is do both people and the truth a disservice.
    - CamperBob2 8y ago
      Name one instance where Zimbardo's findings have been born out is "so many different contexts"? Probably the best examples would be found in the in-group/out-group dynamics in religious cults and closed-state regimes. The Nazis exploited these principles in the 1930s to impressive effect. But what happened in Zimbardo's experiment is more closely analogous to what you see in places like North Korea today, along with abuses carried out in insular groups ranging from the Branch Davidians to the Mormons. The same hierarchies form and the same roles are played. It is foolish in the extreme to dismiss Zimbardo's work because of a few ethical hangups. What he did is highly reproducible, but only outside the bounds of regulated academia. Milgram has indeed come under similar criticism from people who are desperate to find another explanation -- any other explanation -- to distract themselves from the truth about what human beings actually are.
      - ksenzee 8y ago
        Did you seriously just compare Mormons to Branch Davidians? And North Korea? Mormonism has its problems (excellent article on that at https://longreads.com/2018/06/07/meet-the-new-mormons https://longreads.com/2018/06/07/meet-the-new-mormons) but that is totally over the top. If you want to leave North Korea, you risk your life and your family's lives in a terrifying journey over the Chinese border. If you want to leave Mormonism, you write a letter saying "please remove me from your list."
        dwaltrip 8y ago
        I agree with you that GP's comparison was a bit drastic, to say the least. However, you have gone too far in the other direction. You make it sound like leaving a religion is just as easy as unsubscribing from a newsletter. Visit one of the ex-religion subreddits sometime. I know Mormonism and Christianity both have one. To be fair, those online groups will be selection biased towards the most difficult situations. But I think many of those experiences are not terribly uncommon.
        CamperBob2 8y ago
        If you want to leave North Korea, you risk your life and your family's lives in a terrifying journey over the Chinese border. If you want to leave Mormonism, you write a letter saying "please remove me from your list." This is exactly like saying, "If he beats you, why don't you just leave him?" But I don't expect the people arguing with me in this thread to understand that, any more than I'd expect you to understand why Zimbardo's participants didn't just blow a whistle on the whole thing and walk out as soon as the experimental ethics went south.
- pas 8y ago
  It's not unheard of though. Just likely not ad hoc repeatable, reproducible. That said, these group experiments are very hard to control (as in control for confounding variables/factors), and very easy to screw up methodologically (maybe you don't pre-register one interesting hypothesis). Very hard to design properly (forget to control lighting), and even harder to run it well (the building where you want to do it doesn't have adjustable lighting, or you want cold water showers only, but it's not that simple to achieve, so you don't and just mention it in the paper - was that the cause of a negative/positive result or not?).
jpfed 8y ago
>Likewise, if the SPE is invalid, it doesn't imply that average people aren't capable of horrific behavior - it simply means we have less evidence to determine that than we thought we did. Agreed; SPE just doesn't constitute evidence for Zimbardo's particular narrative. >According to Alex Haslam and Stephen Reicher, psychologists who co-directed an attempted replication of the Stanford prison experiment in Great Britain in 2001, a critical factor in making people commit atrocities is a leader assuring them that they are acting in the service of a higher moral cause with which they identify — for instance, scientific progress or prison reform. This quote, and everything actually observed during the SPE, is consistent with Milgram's work, which has been replicated a zillion times.
- hmwhy 8y ago
  > This quote, and everything actually observed during the SPE, is consistent with Milgram's work, which has been replicated a zillion times. I think you may be cherry-picking quotes here, here is another from much later in the article: > In another blow to the experiment’s scientific credibility, Haslam and Reicher’s attempted replication, in which guards received no coaching and prisoners were free to quit at any time, failed to reproduce Zimbardo’s findings. Far from breaking down under escalating abuse, prisoners banded together and won extra privileges from guards, who became increasingly passive and cowed. According to Reicher, Zimbardo did not take it well when they attempted to publish their findings in the British Journal of Social Psychology.
  - boomboomsubban 8y ago
    Milgram's work is on the power of authority, so your quote showing that behavior did not follow the desired results without the professor present is also consistent with Milgram.
    - JackCh 8y ago
      > At the end of each of the Bridgeport experiments [Condition 23], before he revealed the hoax, Williams asked each man what he thought the Research Associates of Bridgeport was and why he had volunteered. Milgram had presumably told Williams to ask this to demonstrate that subjects had no idea that Yale was behind the research. Most said they didn't know, but many assumed that it was an organization conducting scientific research. Williams probed this issue with several subjects, and it was obvious that even though many didn't have the slightest clue about the organization and what it ostensibly did, they were still prepared to trust it because of the scientific imprimatur. One man who had gone to 450 volts said that he was motivated by his six-year-old daughter. > Man: I can only say that I was- look, I'm willing to do anything that's ah, to help humanity, let's put it that way. > Williams: Right, that's what we're doing. > Man: I've got- I've got a child that's a cerebral palsy child. > Williams: Have you really? > Man: And you know they're experimenting steadily on trying to find a cure for it. It's a sad thing. From his correspondence we know these experiments were very personal to Milgram, motivated in no small part by his desire to understand the Holocaust. Yet these experiments were not testing obedience to generic authority, it wasn't testing obedience to military officers or gestapo thugs. The above man was compliant because he thought he was helping to advance medical science. The whole thing is farcical.
shkkmo 8y ago
Except we do have evidence that the specific claims made by Zimbardo were fraudulent and we also have experimental evidence that shows that these results are not accurate if you actually implement his claimed methodology. SPE now needs to be taken as a cautionary tale about ethics and science, nothing more.
- pas 8y ago
  For the very interested but so far unlucky: where are these specific claims and the documentation of their fraudulent nature? Thanks in advanace!
  - JackCh 8y ago
    The article goes over several. Off the top of my head: the supposed mental breakdown of Korpi (he was faking it), Zimbardo claiming he wasn't politically motivated, Zimbardo claiming the students were free to leave at any time, Zimbardo lying or misleading as to what degree the 'guards' had been coached (specifically with regard to the role of Jaffe.) Details about each of these are available in the article.
mc32 8y ago
A problem with that is that people will remain tainted by the urban legend type persistence of the conclusions. So if one could void this study that’d be a better outcome.
banachtarski 8y ago
The premise of the experiment isn't just that people are capable of horrific behavior. It's that the thing that brings this about is largely circumstantial and a function of our role in society.
laretluval 8y ago
The study wasn't just invalidated, it was misleadingly characterized by the people who ran it and promoted its findings. This does more than just withdraw some evidence in favor of the idea that ordinary people can easily commit horrific behavior. It provides new, positive evidence that people have an incentive to spread this idea fraudulently. This should properly cause us to re-examine all evidence for this thesis very closely.
donbright 8y ago
Anyone who was accepted to Stanford in the early 1970s was, by definition, not an average person. That's the whole point of being accepted at Stanford. I'm not saying it means Ivy League students are more likely to be psychopaths, but I am saying it's not scientifically valid to take a study of a population from a hyper-elite American college during a draft war and apply the results of that study to the average person, especially if the study is supposed to remark on factors regarding social pressure and social expectations. "We knew [the guards] couldn’t hurt us, they couldn’t hit us. They were white college kids just like us, so it was a very safe situation. "
- Avshalom 8y ago
  College Students Are WIERD. As the paper put it.
hmwhy 8y ago
I think you have presented a fallacy: > If an experiment is run that says the sky is blue, then its invalidation does not mean that the sky is not blue. If an experiment's hypothesis is that the sky is blue and the sky is indeed blue, then there is nothing wrong and there is nothing to be invalidated. If an experiment's hypothesis is that the sky is blue because there is a bunch of leprechauns throwing blue Skittles at it, and there are evidence that this not the case; then the experiment is to be invalidated and, in your own words, "[i]t means we no longer have evidence for that conclusion." If you don't have the evidence to support your hypothesis, then you can't draw any conclusions except for, and at best, that there is no evidence to support your hypothesis. To put it into the context of the running example, this translates to the sky is blue but it's not because leprechauns are throwing blue Skittles at it. You can't say just because my hypothesis about leprechauns is invalidated, it doesn't mean that there are not leprechauns throwing skittles at it—because that's simply just what you believe and wish to be the case; and a good scientist should be impartial to beliefs. More importantly, the whole point of the article is beyond invalidating the SPE. It's, in my opinion, a great piece about much deeper problems in scientific or, well, "scientific" methods.
- pas 8y ago
  It still could be leprechauns, though. A null hypothesis is not the same as the inverse of the H1.

whiddershins 8y ago

Well, the message people got was that students who were knowingly participating in a college psych study became spontaneously sadistic within just a day or two. That feels intuitively ridiculous, and has no evidence I know of to support it, except this study.

CamperBob2 8y ago
The idea behind the study was to try to understand how an entire nation - Germany - could go berserk with hatred and sadism. Scientific or not, the burden of proof lies with those who dispute Zimbardo’s (and Milgram’s) findings, because they have been borne out so many times in so many different contexts. Their work has never been more relevant than it is now, as we witness the rise of Trumpism. What alternative explanations would you propose?
- shkkmo 8y ago
  1) Milgram's and Zimbardo's findings are very different. Milgram's have been backed up by many replications and are often mis-understood. 2) We have both experimental and factual evidence that shows that Zimbardo's findings were lies. 3) The entire nation of Germany did not go berserk with hatred and sadism. 4) Name one instance where Zimbardo's findings have been born out is "so many different contexts"? The rise and success of Nazism (like most social movements, including 'Trumpism') was the result of a confluence of a number of factors. To pretend that it was just "how people are" is do both people and the truth a disservice.
  - CamperBob2 8y ago
    Name one instance where Zimbardo's findings have been born out is "so many different contexts"? Probably the best examples would be found in the in-group/out-group dynamics in religious cults and closed-state regimes. The Nazis exploited these principles in the 1930s to impressive effect. But what happened in Zimbardo's experiment is more closely analogous to what you see in places like North Korea today, along with abuses carried out in insular groups ranging from the Branch Davidians to the Mormons. The same hierarchies form and the same roles are played. It is foolish in the extreme to dismiss Zimbardo's work because of a few ethical hangups. What he did is highly reproducible, but only outside the bounds of regulated academia. Milgram has indeed come under similar criticism from people who are desperate to find another explanation -- any other explanation -- to distract themselves from the truth about what human beings actually are.
    - ksenzee 8y ago
      Did you seriously just compare Mormons to Branch Davidians? And North Korea? Mormonism has its problems (excellent article on that at https://longreads.com/2018/06/07/meet-the-new-mormons https://longreads.com/2018/06/07/meet-the-new-mormons) but that is totally over the top. If you want to leave North Korea, you risk your life and your family's lives in a terrifying journey over the Chinese border. If you want to leave Mormonism, you write a letter saying "please remove me from your list."
      - dwaltrip 8y ago
        I agree with you that GP's comparison was a bit drastic, to say the least. However, you have gone too far in the other direction. You make it sound like leaving a religion is just as easy as unsubscribing from a newsletter. Visit one of the ex-religion subreddits sometime. I know Mormonism and Christianity both have one. To be fair, those online groups will be selection biased towards the most difficult situations. But I think many of those experiences are not terribly uncommon.
      - CamperBob2 8y ago
        If you want to leave North Korea, you risk your life and your family's lives in a terrifying journey over the Chinese border. If you want to leave Mormonism, you write a letter saying "please remove me from your list." This is exactly like saying, "If he beats you, why don't you just leave him?" But I don't expect the people arguing with me in this thread to understand that, any more than I'd expect you to understand why Zimbardo's participants didn't just blow a whistle on the whole thing and walk out as soon as the experimental ethics went south.
pas 8y ago
It's not unheard of though. Just likely not ad hoc repeatable, reproducible. That said, these group experiments are very hard to control (as in control for confounding variables/factors), and very easy to screw up methodologically (maybe you don't pre-register one interesting hypothesis). Very hard to design properly (forget to control lighting), and even harder to run it well (the building where you want to do it doesn't have adjustable lighting, or you want cold water showers only, but it's not that simple to achieve, so you don't and just mention it in the paper - was that the cause of a negative/positive result or not?).

jpfed 8y ago

>Likewise, if the SPE is invalid, it doesn't imply that average people aren't capable of horrific behavior - it simply means we have less evidence to determine that than we thought we did. Agreed; SPE just doesn't constitute evidence for Zimbardo's particular narrative. >According to Alex Haslam and Stephen Reicher, psychologists who co-directed an attempted replication of the Stanford prison experiment in Great Britain in 2001, a critical factor in making people commit atrocities is a leader assuring them that they are acting in the service of a higher moral cause with which they identify — for instance, scientific progress or prison reform. This quote, and everything actually observed during the SPE, is consistent with Milgram's work, which has been replicated a zillion times.

hmwhy 8y ago
> This quote, and everything actually observed during the SPE, is consistent with Milgram's work, which has been replicated a zillion times. I think you may be cherry-picking quotes here, here is another from much later in the article: > In another blow to the experiment’s scientific credibility, Haslam and Reicher’s attempted replication, in which guards received no coaching and prisoners were free to quit at any time, failed to reproduce Zimbardo’s findings. Far from breaking down under escalating abuse, prisoners banded together and won extra privileges from guards, who became increasingly passive and cowed. According to Reicher, Zimbardo did not take it well when they attempted to publish their findings in the British Journal of Social Psychology.
- boomboomsubban 8y ago
  Milgram's work is on the power of authority, so your quote showing that behavior did not follow the desired results without the professor present is also consistent with Milgram.
  - JackCh 8y ago
    > At the end of each of the Bridgeport experiments [Condition 23], before he revealed the hoax, Williams asked each man what he thought the Research Associates of Bridgeport was and why he had volunteered. Milgram had presumably told Williams to ask this to demonstrate that subjects had no idea that Yale was behind the research. Most said they didn't know, but many assumed that it was an organization conducting scientific research. Williams probed this issue with several subjects, and it was obvious that even though many didn't have the slightest clue about the organization and what it ostensibly did, they were still prepared to trust it because of the scientific imprimatur. One man who had gone to 450 volts said that he was motivated by his six-year-old daughter. > Man: I can only say that I was- look, I'm willing to do anything that's ah, to help humanity, let's put it that way. > Williams: Right, that's what we're doing. > Man: I've got- I've got a child that's a cerebral palsy child. > Williams: Have you really? > Man: And you know they're experimenting steadily on trying to find a cure for it. It's a sad thing. From his correspondence we know these experiments were very personal to Milgram, motivated in no small part by his desire to understand the Holocaust. Yet these experiments were not testing obedience to generic authority, it wasn't testing obedience to military officers or gestapo thugs. The above man was compliant because he thought he was helping to advance medical science. The whole thing is farcical.

shkkmo 8y ago

Except we do have evidence that the specific claims made by Zimbardo were fraudulent and we also have experimental evidence that shows that these results are not accurate if you actually implement his claimed methodology. SPE now needs to be taken as a cautionary tale about ethics and science, nothing more.

pas 8y ago
For the very interested but so far unlucky: where are these specific claims and the documentation of their fraudulent nature? Thanks in advanace!
- JackCh 8y ago
  The article goes over several. Off the top of my head: the supposed mental breakdown of Korpi (he was faking it), Zimbardo claiming he wasn't politically motivated, Zimbardo claiming the students were free to leave at any time, Zimbardo lying or misleading as to what degree the 'guards' had been coached (specifically with regard to the role of Jaffe.) Details about each of these are available in the article.

mc32 8y ago

A problem with that is that people will remain tainted by the urban legend type persistence of the conclusions. So if one could void this study that’d be a better outcome.

banachtarski 8y ago

The premise of the experiment isn't just that people are capable of horrific behavior. It's that the thing that brings this about is largely circumstantial and a function of our role in society.

laretluval 8y ago

The study wasn't just invalidated, it was misleadingly characterized by the people who ran it and promoted its findings. This does more than just withdraw some evidence in favor of the idea that ordinary people can easily commit horrific behavior. It provides new, positive evidence that people have an incentive to spread this idea fraudulently. This should properly cause us to re-examine all evidence for this thesis very closely.

donbright 8y ago

Anyone who was accepted to Stanford in the early 1970s was, by definition, not an average person. That's the whole point of being accepted at Stanford. I'm not saying it means Ivy League students are more likely to be psychopaths, but I am saying it's not scientifically valid to take a study of a population from a hyper-elite American college during a draft war and apply the results of that study to the average person, especially if the study is supposed to remark on factors regarding social pressure and social expectations. "We knew [the guards] couldn’t hurt us, they couldn’t hit us. They were white college kids just like us, so it was a very safe situation. "

Avshalom 8y ago
College Students Are WIERD. As the paper put it.

hmwhy 8y ago

I think you have presented a fallacy: > If an experiment is run that says the sky is blue, then its invalidation does not mean that the sky is not blue. If an experiment's hypothesis is that the sky is blue and the sky is indeed blue, then there is nothing wrong and there is nothing to be invalidated. If an experiment's hypothesis is that the sky is blue because there is a bunch of leprechauns throwing blue Skittles at it, and there are evidence that this not the case; then the experiment is to be invalidated and, in your own words, "[i]t means we no longer have evidence for that conclusion." If you don't have the evidence to support your hypothesis, then you can't draw any conclusions except for, and at best, that there is no evidence to support your hypothesis. To put it into the context of the running example, this translates to the sky is blue but it's not because leprechauns are throwing blue Skittles at it. You can't say just because my hypothesis about leprechauns is invalidated, it doesn't mean that there are not leprechauns throwing skittles at it—because that's simply just what you believe and wish to be the case; and a good scientist should be impartial to beliefs. More importantly, the whole point of the article is beyond invalidating the SPE. It's, in my opinion, a great piece about much deeper problems in scientific or, well, "scientific" methods.

pas 8y ago
It still could be leprechauns, though. A null hypothesis is not the same as the inverse of the H1.