3 ms·
It always amazes me how lazy and amateurish this type of fraud is. Copying and pasting pictures? Can't even add a little fuzz? I'm often trying to teach scienti
by DonsDiscountGas 3y ago
It always amazes me how lazy and amateurish this type of fraud is. Copying and pasting pictures? Can't even add a little fuzz? I'm often trying to teach scientists to code, if they actually learned they could fake data much more credibly. Schon[0] was another big one; he didn't copy images but rather numbers which made up graphs. Adding some noise would've been really easy. It makes one wonder how much fraud is never caught simply because the fraudsters are a little smarter.
A basic assumption in science is that the raw facts a scientist presents are true. People question the statistical methods, they question which conclusions are appropriate given the data, but raw data itself is assumed to be accurate. We apply a lot more scrutiny to clinical trials (for obvious reasons), but trying to apply that same standard to all research everywhere would be cost prohibitive and slow research by a huge amount.
A lot of journals use image-duplication detectors now (the post mentions ImageTwin.ai) so I expect this particular form of fraud will stop. I suspect cherry-picking data ("inappropriate data exclusion") is the most common form, and will remain so. It's very difficult (often impossible) to detect.
On the positive side, I suspect the impact of stuff like this is fairly minimal. Everybody in the field knows that experimental biology is difficult and results are untrustworthy. Even excluding outright fraud, it's really easy to just mess something up. Or get a result which is "true" but doesn't generalize, and so it's useless. Good scientists don't trust something just because it's in Nature/Science/Cell, if they really care about the result then they replicate it before building on it. This would remain true even if all deliberate fraud stopped immediately.
[0] https://en.wikipedia.org/wiki/Sch%C3%B6n_scandal https://en.wikipedia.org/wiki/Sch%C3%B6n_scandal
[1] I dunno about the mouse one, it doesn't seem to be a direct copy/paste and a good experimentalist will do a lot to ensure consistent conditions. Everything else is pretty blatant though.
- FrustratedMonky 3y agoThis is all true, but think your conclusions are not correct. I don't think this is true for everyone. If it is difficult, and easy to mess something up, then all the more reason to have as accurate results as possible. Fudging data isn't acceptable. "Everybody in the field knows that experimental biology is difficult and results are untrustworthy" "Good scientists don't trust something just because it's in Nature/Science/Cell, if they really care about the result then they replicate it before building on it" -> But, I'm Joe Blow, I'm not setting up a lab to replicate every study I read about. This might be fine for a VC, test it before building something. But it forgets how many people might make smaller decisions based on an article in Nature or Cell. or Extrema: I just read about the Higgs-Boson, do I need to not trust the results until I can build a collider and replicate it.
- mike_hearn 3y agoIt's not actually fine for VCs. I recall reading somewhere (forget where) that VCs are loathe to invest in biotech because they've been repeatedly burned by startups spending a few million to set up a lab and then failing to replicate the academic result they wanted to commercialize. Getting a startup to the point where you can find out you've been defrauded is expensive, so they prefer to focus on computing where this isn't an issue.
- deleted 3y ago[deleted]
- bombcar 3y ago> It always amazes me how lazy and amateurish this type of fraud is. You mean how lazy and amateurish the fraud that is caught is. I just generally assume most of it is complete bullshit, because you have a group of highly-paid professionals producing write-only documents that nobody gives a damn about. This is a recipe for a constant level of low-grade fraud because people are lazy.