3 ms·

The replication crisis hasn’t helped either. When done correctly, science can provide invaluable information. But publishing a paper does not mean science was

The replication crisis hasn’t helped either. When done correctly, science can provide invaluable information. But publishing a paper does not mean science was done. And science communicators have on occasion treated inferences made from research with the seriousness of the research, not with the frivolousness of an informed guess.

eimrine 2y ago
What fields except Psychology/Psychiatry suffer from replication crisis?
- a_vanderbilt 2y ago
  You can consider the beta-amyloid fiasco as a prime example of biomed's replication issues. ML/AL replication issues largely stem from the source data used for training not being available. In my field, of psychotherapy, social and cultural factors change over time making perfect replication impossible. I'm working on a paper now and we are trying to account as much as possible for replication of our results.
- DougN7 2y ago
  I’m in no way qualified to answer, but I recall reading about a slew of publications being retracted across all fields after the results couldn’t be replicated. If I remember right there was a team that has become infamous for simply trying to replicate studies and finding a very large number of them can’t be.
  - syndicatedjelly 2y ago
    Are you able to dig up that paper or the findings the team found around replication and share?
- snovymgodym 2y ago
  Economics
- aredox 2y ago
  Actual medical science, down to biochemistry. Look up the replication crisis - if not outright fraud - in Alzheimer research, as an outstanding recent example.
- finnthehuman 2y ago
  Everything. When science communication to the public uses capital-S science as the big group of boffins figuring things out, theres not a lot forgiveness for after the fact subtleties.
syndicatedjelly 2y ago
Is there a good resource or paper you would recommend that summarizes the replication crisis and provides some stats on how many papers have be retracted due to replication issues?

eimrine 2y ago

What fields except Psychology/Psychiatry suffer from replication crisis?

a_vanderbilt 2y ago
You can consider the beta-amyloid fiasco as a prime example of biomed's replication issues. ML/AL replication issues largely stem from the source data used for training not being available. In my field, of psychotherapy, social and cultural factors change over time making perfect replication impossible. I'm working on a paper now and we are trying to account as much as possible for replication of our results.
DougN7 2y ago
I’m in no way qualified to answer, but I recall reading about a slew of publications being retracted across all fields after the results couldn’t be replicated. If I remember right there was a team that has become infamous for simply trying to replicate studies and finding a very large number of them can’t be.
- syndicatedjelly 2y ago
  Are you able to dig up that paper or the findings the team found around replication and share?
snovymgodym 2y ago
Economics
aredox 2y ago
Actual medical science, down to biochemistry. Look up the replication crisis - if not outright fraud - in Alzheimer research, as an outstanding recent example.
finnthehuman 2y ago
Everything. When science communication to the public uses capital-S science as the big group of boffins figuring things out, theres not a lot forgiveness for after the fact subtleties.

syndicatedjelly 2y ago

Is there a good resource or paper you would recommend that summarizes the replication crisis and provides some stats on how many papers have be retracted due to replication issues?