10 ms·
We need to talk about systematic fraud
- allset_ 8y agoThere was a good talk about this at 35C3 [0]. Definitely worth the watch. [0] https://media.ccc.de/v/35c3-9744-inside_the_fake_science_factories https://media.ccc.de/v/35c3-9744-inside_the_fake_science_fac... Edit: You can change the language to English by clicking on the settings cog in the video.
- hk-mars 8y agoThanks :)
- hk-mars 8y agoGood talk about xx community’s intention.
- nostrebored 8y agoWhy does the author assume that this isn't a norm among researchers? The sheer number of irreproducible studies we have should indicate that this behavior is way more common than people would like to admit.
- djsumdog 8y agoI think back to the recent group of academics that wanted to prove how most Grievance Studies journals don't property review submissions. One of the papers they got accepted had chapters from Mein Kampf rewritten with terminology from modern social cause rhetoric. Instead of accepting the issues, with the entire process, these professors are now facing disciplinary hearings for submitting false research. In a way I can understand this; they did after all submit papers they knew weren't academic (in bad faith?) in order to prove a greater point. But does that justify what they did?
- michaelmrose 8y agoYes
- notduncansmith 8y agoI also believe what they did was justified. They did actual science and revealed that a number of publishers within this field demonstrate such a strong preference for virtue-signaling papers that they have lowered the bar for critical thought in both content and review. One of the honeypot papers won an award. That shows you how obvious the publisher bias is, and how obvious it must have been to these people before they decided to do something about it. Not only did these individuals risk their careers to help save a dying system with this project, they held themselves to a pretty high standard of execution. We place lots of limits on the amount of heroism individuals are allowed to display, and I think that’s mostly beneficial - but sometimes we need heroes.
- gizmo686 8y agoI'm not an academic, but aren't there standard practices for doing that sort of ethically questionable research. Namely, an ethics committee that you go to for the green light before proceeding.
- learc83 8y agoThere's usually an institutional review board that you go through when using research subjects, but you don't need to do that to publish something like a new algorithm you developed in a CS journal. In this case, the researcher probably should have gotten IRB approval because there were test subjects--the journal editors, peer reviewers, and probably journal readers. But I'm assuming they just skipped that process and said there were no human subjects.
- Baeocystin 8y ago>In a way I can understand this; they did after all submit papers they knew weren't academic (in bad faith?) in order to prove a greater point. But does that justify what they did? A thousand times yes. Exposing cargo cults that attempt to co-opt the hard-earned cachet of genuine scientific inquiry for their own ideological ends is exactly what is needed to keep science functional.
- lapnitnelav 8y agoYeah but it's a thin line to walk. If you don't do it, then you let all the pseudo-science out there masquerading as real science, which is bad. But if you overdo it, you feed into the distrust of proper science too, see Brexit and we're done listening to experts soundbite, or any of the anti-vax crowd.
- Baeocystin 8y agoIn my experience, people that have profoundly anti-scientific beliefs have always been such; whether their purported trigger is Jenny McCarthy or an odd alignment of Jupiter, it's hard to know if it's even relevant- the problem is that they don't have the skillset to make rational choices. And I just don't see a Sokal-style hoax making a whit of difference in their minds, as there are a million other things that could do the same. In other words, their feelings of anti-science came first. Whatever reason provided is ex post facto confabulation. Meanwhile, the sciences themselves need this kind of scrutiny to stay scientific. I'm open to being wrong. But I think it is a mistake to put too much weight to the 'we should be careful what the people who never use science anyway' consider.
- shrewduser 8y agothere are a number of fields that seem to operate on motivated reasoning over objective truth.
- pasabagi 8y agoThese kind of stunts are pretty annoying, though. I know with the original (who was it again?), it was essentially a case of the academic leveraging his reputation, the editors being a bit like 'this seems kooky, but sure, you're the expert', then him turning around and pretending like he'd fooled everyone.
- hnuser123456 8y agoIt was by James Lindsay, Peter Boghossian, and Helen Pluckrose. They submitted papers with fictitious names and institutions. They were not leveraging their own reputations (besides the publication's, if they were accepted, and a Richard Baldwin who lent his identity for some of them.) They spent time reviewing and citing existing work, so they could legitimately claim to be building on it, but then try to go in the most absurd directions possible, so absurd that any self-respecting academic publication ought to immediately reject it with disgust, and see what happened. 7 out of 20 such papers were accepted, 4 were published, they received 4 invitations to peer-review other papers, and 1 "gained special recognition for excellence." https://areomagazine.com/2018/10/02/academic-grievance-studies-and-the-corruption-of-scholarship/ https://areomagazine.com/2018/10/02/academic-grievance-studi...
- hyeonwho4 8y ago... and they were only discovered to be frauds by the twitter feeds that mock social sciences research.
- pasabagi 8y agoIf I published something in any of the innumerable scientific 'journals' that bombard my spam box, I could probably publish whatever I liked. That doesn't mean I can say science is methodologically flawed. The humanities, no doubt, deserve criticism, but I honestly don't see the appeal of stunts designed to 'prove' that a certain field is not worth the time of day, by people who don't even understand the field at the most basic level. How would they know? Why would they care? It strikes me as embarrassing for everybody involved- embarrassing, to publish something without properly vetting it, embarrassing, to dismiss something as nonsense without actually having the measure of it, embarrassing, to be so enthusiastic about this kind of 'proof', which so obviously combines ignorance with arrogance. There is no such thing as grievance studies. Critical theory has nothing to do with identity. The whole thing is about as close to the mark as Pat Buchanan's critique of feminism, and about as clever. In short, depressing.
- pfortuny 8y agoOf course it is justified: you can only prove that kind of abuse by making it glare: otherwise, the “secrecy” of the peer-review process is the excuse.
- bartread 8y ago> But does that justify what they did? Yes, it does. These journals are an absolute joke, make a mockery of any serious attempt to advance knowledge and understanding, and deserve to be pilloried. Their standards of rigour and review are shockingly poor and as such they do not provide a suitable vehicle for the publication of genuine research, or for measured consideration of the content they do publish. Just this week I ran across this, where a couple of the academics concerned were interviewed by Joe Rogan late last year: https://www.youtube.com/watch?v=AZZNvT1vaJg&t=1s https://www.youtube.com/watch?v=AZZNvT1vaJg&t=1s Fascinating, horrifying, and entertaining in equal measure. For more background, there's also this on wikipedia: https://en.wikipedia.org/wiki/Grievance_Studies_affair https://en.wikipedia.org/wiki/Grievance_Studies_affair
- pfortuny 8y agoThank you for your clarity. We need more of this.
- CJefferson 8y agoIt doesn't justify what they did, and what they did has very little value, for 4 reasons. 1) there are ethics panels for a reason -- many people have run unacceptable experiments on people. Academics don't get to skip the ethics checks because fhey feel like it. 2) their experiment was poorly designed. On their first attempt of their papers got ejected, so they polished and resubmitted them. What is their exact scientific theory? 3) they were clearly trying for contraversy. Maybe some part of Mein Kampf are actually useful valid statements to make. Just because of the terribleness of the Nazis, doesn't mean everything Hitler ever said, or wrote, should automatically be rejected from journals. 4) maybe Grievence Studies actually review better than everyone else. Any good study need a control.
- kristianc 8y ago> 2) their experiment was poorly designed. On their first attempt of their papers got ejected, so they polished and resubmitted them. What is their exact scientific theory? They've outlined this. There is a specific Grievance Studies nomenclature and orthodoxy which the first papers did not adhere to. When they republished and resubmitted, they followed the Orthodoxy and they got through. That IS the scientific method. You run an experiment, observe the results. You tweak a few variables and see what happens under those conditions. It’s what distinguishes their work from Grievance Scholarship, where you know the conclusion you want before you start. > Maybe some part of Mein Kampf are actually useful valid statements to make. Um?
- CJefferson 8y agoLet's pick a random bit of Mein Kampf (I just scrolled to a random page in the middle in a randomly chosen translation). This looks, to me, like something that wouldn't be out of place in any discussion of "Fake News". This is the problem with using bits of Mein Kampf, it feels designed to shock and offend. If I got this text below into an article in a major newspaper, would that make that newspaper fundamentally broken / untrustworthy, because it happens to come, word for word, from Mein Kampf? Quote begins: Just in journalistic circles one usually prefers to call the press a 'great power' of the State. As a matter of fact its importance is truly enormous. It cannot be overestimated ; it is indeed actually the continuation of the education of youth in advanced age. Thereby one can divide the readers as a whole into three groups: First, those who believe everything they read; Secondly, those who no longer believe anything; Thirdly, those who critically examine what they have read and judge accordingly.
- ATsch 8y agoI think it's surprising that on a site such as HN the narrative of these authors is so readily accepted without any second thought. The claim is that they just made up trash and submitted it to high-quality peer-reviewed journals and they accepted them. The reality is much less outragous. Of the 20 papers, 4 were published and 3 more accepted for publication. They spent a year doing this. The authors note that they submitted the papers to "top journals in the field", leaving out the fact that all of those top journals rejected the 20 papers and they had to revise the papers and send them to shoddier journals instead. The review quoted by the authors was from an unsure grad student doing their first review of a paper. Said student later said they knew the paper was crap, but still tried to be constructive. The assertion of the authors is that this stuff getting published means the whole field is worthless. Which is of course ridiculous. Medicine didn't become obsolete when a journal published a paper with an abstract ending in "The fact that these last sentences appear in the published paper tell you, dear reader, exactly how seriously the editorial process has been taken". Computer Science didn't implode when three MIT students made an AI to generate random papers and 120(!) were accepted by the reputable IEEE and Springer. The blame was back then correctly put on the publishers and the general flaws of the current scientific process instread. So, as people have pointed out, it's ironic that their essay itself is incredibly scientifically unrigorous. No controls, unsourced claims, biased authors and conclusions that aren't supported by the data.
- prepend 8y ago“The assertion of the authors is that this stuff getting published means the whole field is worthless.” I don’t get this at all from the authors. My take is that they call out serious flaws in the rigor of how papers are reviewed. I don’t think it’s reasonable to extend that to say the field is worthless. I did read through many papers in the referenced journals and it seems really surprising to me. I’d love to see some of the research reproduced. But I’m not even sure how you could scientifically prove a field worthless.
- ATsch 8y ago> I don’t get this at all from the authors. My take is that they call out serious flaws in the rigor of how papers are reviewed. I don’t think it’s reasonable to extend that to say the field is worthless. I think it's rather undeniable that the Authors essay was not a good-faith attempt at criticizing the peer-review process, but an attempt to discredit certain fields that they didn't like, even by their own admission. I mean, the title of the essay alone should make this very clear. Here's some quotes nonetheless: > We spent that time writing academic papers and publishing them in respected peer-reviewed journals associated with fields of scholarship loosely known as “cultural studies” or “identity studies” > As a result of this work, we have come to call these fields “grievance studies” > We undertook this project to study, understand, and expose the reality of grievance studies, which is corrupting academic research > The biggest difference between us and the scholarship we are studying by emulation is that we know we made things up. > these fields of study do not continue the important and noble liberal work of the civil rights movements; they corrupt it while trading upon their good names to keep pushing a kind of social snake oil onto a public that keeps getting sicker [Note also that this essentially an academic way of phrasing the same things you'll hear people like the far-right Stefan Molyneux (on who's show one of the authors has been a guest several times) say.] Of importance here that it's not the scientific practices that are "corrupting academia" but the fact that these fields exist at all. I'm sure you can find more if you really want to. Compare this to say the "reproducibility in Psychology" study, which unsurprisingly doesn't dedicate half of their text to talking about why the authors think psychology is bad. Don't be mistaken: The whole thing was an attempt to cash in on the general crisis the scientific process is facing to score some easy political points and not a neutral and constructive attempt at improving the quality of research in the field. Or rather, their proposal at improving the quality would involve getting rid of the fields that they don't personally like.
- dang 8y agoPlease don't take HN on classic flamewar tangents. It leads to the same few hot controversies taking over everything else, and the quieter, less predictable discussions that we actually want here are the ones that tend to get burnt out of the picture as a result. https://news.ycombinator.com/newsguidelines.html https://news.ycombinator.com/newsguidelines.html
- JackPoach 8y agoI thing lots of wrong people go into science for the wrong reasons. This is why you'll never really be able to do anything about this problem, unless you have a way to screen them out.
- JPLeRouzic 8y agoOne single meaningless test: I am not a scientist and do not want to draw any general lessons but I took a document about an ALS gene therapy that I wrote for private use, and used the tool mentioned in the article. It found a distant article about a tumor protein. Indeed both documents are unrelated, mine was not published and they have very little in common, only the word protein.
- JPLeRouzic 8y agoI did it again with: Dietary salt promotes neurovascular and cognitive dysfunction through a gut-initiated TH17 response https://doi.org/10.1038/s41593-017-0059-z https://doi.org/10.1038/s41593-017-0059-z And it found: Knockdown of NOB1 expression inhibits the malignant transformation of human prostate cancer cells doi: 10.1007/s11010-014-2126-z
- sgt101 8y agoApologies: I'm being obtuse.... Which tool?
- JPLeRouzic 8y agoThis one: http://scigendetection.imag.fr/TPD52/ http://scigendetection.imag.fr/TPD52/ Citation: Informatician Cyril Labbé at Grenoble Alps University in France and I have developed a tool, Seek & Blastn (go.nature.com/2hsk06q), to identify such papers on the basis of wrongly identified nucleotide sequences. So far, our work has uncovered dozens of papers and resulted in 17 retractions, with several investigations pending (see Nature 551, 422–423; 2017).
- choppaface 8y agoWhy can’t the peer review system itself just evolve to embrace the full power of the internet? The main reasons these fraudulent strategies are at all effective is because (1) the review process is private and slow and (2) studies aren’t independently reproduced as a part of review. The feedback loop is inherently too slow. To speed it up, one must fight the inertia of senior (tenured) faculty and major funding vehicles. It’s laudible these researchers have invested so much in fighting fraud, but this post shows that the offenders will essentially face no negative consequences for fraud. The researchers worked very hard for hardly any return / justice. Perhaps it’s worth re-inventing science. Open reviews. A network to connect labs that ensures findings are reproduced. We could even re-do much of basic, academic science in the interest of improving exposition and shedding antiquated formulations of theory. What if, in the face of this fraud, we simply reject tradition wholesale? The only tradition should be an honest, reproducible study of Nature.
- CJefferson 8y agoMy problem is, just the "Full power of the internet" end up looking like Facebook, or Reddit, or Twitter, where the fastest and loudest repliers often end up having the biggest effect? Also, independently reproducing studies is super-important, but that going to take HUGE amounts of money, which someone is going to have to pay for. It was have to come from the top, most governments want to see new research, not reproductions, and scientists are guided by that direction.
- ausbah 8y ago"Full power of the internet" doesn't have to be like Facebook or Twitter. Maintaining some sort of decent moderation and having a wider "professional" culture (can't think of a better term here) can allow for some truly insightful interactions in the vein of HackerNews or some better known subreddits.
- ThePhysicist 8y agoJournals became more and more obsolete with the rise of Internet and only managed to retain their position in the academic world due to their citation metrics system that is used to judge academic worth and the enormous amount of articles that they've amassed over the last centuries and that academics need access to. I think it will take at least another 30 years until we will be able to stop relying on closed-access journals, possibly longer since there are still countless high-profile articles that only get published in those journals (though some universities and funding agencies changed their policies to demand that results of publicly funded research are freely available). In Physics and many other fields Arxiv.org has basically replaced journals as the primary way of getting the latest research results. Unfortunately many high-impact-factor journals like Nature forbid you to publish a preprint of your article there (at least that was the case in 2012) so that they can defend their claim of publishing "cutting-edge" results only (which due to their long review processes are often 12 months old by the time they're actually published). The most ridiculous thing is that the journals today do little more than act as an intermediary between the authors of a paper and the reviewers, which work for free and are colleagues from the same field. That and maybe styling the papers a bit, which is (IMHO) unnecessary in most cases as the source LaTeX version usually provides very good design already.
- speedplane 8y agoThere are certainly problems with journals, but they do provide one benefit: they are a source of trust. If you read something in a major publication, you can trust it more than if it was just posted to a website. With the internet, reliable sources of trust are becoming more important, not less. I'm not condoning the current extremely expensive journals that prohibit access to the public, but a completely open model where anyone from anywhere can post anything isn't the answer either.
- ThePhysicist 8y agoWhat creates trust is (IMHO) not the journal but the peer review process, and I think we can find a way to do that without invoking a middleman. Arxiv.org already started doing this and I'm confident that a community-managed review system will easily be able to beat the journal's current systems in quality, speed and reliability. It works in other domains (see e.g. Wikipedia, Stackoverflow) so why shouldn't it work in the academic world?
- bounder 8y agoWouldn't it be nice if there was a platform, some kind of hub where all research papers could be published and visible for anyone with an interest in the particular field. The platform would allow anyone, be it academics or just field experts to request for a change or addition of text. Anyone could see these (pull)requests and the initial author has the power to accept or deny it. This allows for peer reviews and corrections being integrated into the paper, making the whole process more organic. Any change to paper is logged and tracked so you could see the origin of a change and it's reason. Fraudulent papers could be marked by the research community as such. I'm being a bit sarcastic here, but a technology such as git with a platform such as GitHub could maybe make the process of publishing and reviewing research papers easier to control. Maybe you have to tailor it a bit to make it easier to work with this use case. Like open source, peers can start adding and reviewing directly at the source, instead writing a new paper or writing to all of the scientific journals to issue a different statement.
- semi-extrinsic 8y agoThere are certainly initiatives going this way. E.g. LiveCOMS in my own field. The crux of the matter is whether these will gain traction or not. https://livecomsjournal.github.io/about/ https://livecomsjournal.github.io/about/
- lkrubner 8y agoSubversion would be the obvious choice, not git. The whole point of a DVCS is that it avoids having a canonical repo, whereas in science we very much want to have a canonical version of the truth (otherwise there would be no such thing as fraud, if everyone is allowed their own version of the truth), and Subversion defaults to having a canonical version.
- bounder 8y agoI agree. As I said probably the tools and technology should be tailor for the specific use case of scientific papers. It would be nice however that these papers evolve online, instead of the written in stone papers that are publish today in scientific journals. A small note instructing the reader that a certain theory has been disproved or changed in the original paper would already help.
- hkon 8y agoEvery time i see a headline with that wording "we need to talk about x" I just ignore it. Often it's just click bait into something that is not really up for serious discussion and should rather be "I need to tell you what to think". I'm writing this to reduce the usage of it. And no, I will not write an article with that title about that subject.
- joppy 8y agoHowever, this is an article written by a researcher in a particular field, published on the website of the best-known and most reputable journal in that field, trying to get a message out to members of that same field, about a topic that nobody wants to discuss. It seems like a pretty appropriate use of "We need to talk about ..." to me.
- kyloon 8y agoThe scientific process typically involves making inferences and conclusions based on an observation, whereby the result often include biases and in some cases even ill-constructed hypotheses that are caused by assumptions and imperfect information. One way to reduce 'fraud' and also increase accountability of the individuals and organizations is to secure raw data at its source which the veracity of the data that will be subsequently used to support downstream conclusions can be easily verified and attributed to its source. I'd say a bottom up approach here is more holistic as it incentivizes people to produce high quality research that future work can then be reliably be built on top of.
- OliverJones 8y agoThis author and her collaborator developed a tool to flag potential issues in papers. It appears to be FOSS, and based on a well-understood piece of bioinformatics code. "Nature" doesn't run material from cranks and misfits, so hopefully this will start a serious discussion. Going forward, should journals, or the peer-reviewers they engage, test new papers with this tool? Sure, it turns up false positives and false negatives, so its results cannot be interpreted mindlessly. It is also possible to game a tool like this. But it seems obvious some authors are already gaming the system. Undergrad teachers use software tools to check student writing for plagiarism. Shouldn't information-based science use similar tools? We hackers can contribute to this kind of effort by encouraging and supporting open-source inspectable tools. Maybe there's even a business opportunity around maintaining and using the tools.
- luminati 8y agoWhy not call a spade a spade. Better title would be "We need to talk about systematic fraud in China" It's hardly a secret. Any grad student in America already knows this - about the blatant/incredulous cheating and plagiarism that goes on between Chinese students. But oh no, can't talk about it. 'Coz it's racist y'know.
- epmaybe 8y agoThis is moving the goalposts in a dangerous way. You're suggesting that fraud isn't as big of a problem in the US or other countries, when in fact it definitely is. Chinese academics didn't force academics in the USA to fudge data, or play with statistics.
- dgcoffman 8y ago> In a 2016 study1 in Scientometrics, Byrne and Labbé reported 48 problematic papers, including the 30 papers that had incorrectly identified nucleotide fragments. These were all written by authors from China.
- epmaybe 8y agoRight, I'm not denying that the story linked was about fraud in China. But nowhere do they state that the problem is limited to Chinese researchers.
- 8y ago
- dqpb 8y agoIs it fraud or disinformation?
- kenzieL 8y agoStopped reading at "We need to talk about.."
- twic 8y agoThere was an interesting comment on a recent In The Pipeline post about the relationship between academia and industry in drug developmemnt [1]: Academics do some good work in target discovery and validation, but not anywhere near as much as they think they do. Discovery in big pharma has to repeat everything, because about 80% of the time, the published result doesn’t hold up. I suspect this is the result of no job security among grad students and post docs, because we can almost always reproduce data from Japan, where asst profs generate the data. (And we can always reproduce published data from other big pharmas, always.) [1] http://blogs.sciencemag.org/pipeline/archives/2019/02/01/rep-ocasio-cortez-and-where-drugs-come-from#comment-300356 http://blogs.sciencemag.org/pipeline/archives/2019/02/01/rep...
- earthicus 8y agoI'm hesitant to take an anonymous and unsourced internet comment at face value, but assuming it's true, that is quite damning for American academia! It occurs to me that the claimed effect, if it exists, might also be due in part to simple expertise. Or rather a lack of expertise among grad students and to a lesser extent post docs. Is anyone here able to corroborate the claim made in OP's linked comment? And does anyone know what kind of experience and oversight the researchers doing discovery in big pharma will have?
- Brakenshire 8y agoI can’t corroborate it except with another anecdote, a medical researcher told me the same thing in passing. She had worked in academia and in industry, and said that industry doesn’t remotely trust any academic work, and that this had been valid in her experience as well. For example that at the university lab that she joined there was a measurement device which had been regularly used, but which no-one understood how to calibrate properly. I suspect as you say it’s partly down to a lack of expertise, being thrown in at the deep end without much guidance on how to get good measurements, both practically and in terms of avoiding statistical traps like cherry-picking, allied to the pressure to find some exciting results, and journals’ lack of interest in negative results.
- bhk 8y ago
- justinclift 8y ago> Finally, efforts to police the literature need to be valued as highly as the publication of original data. It is more than ironic that systematic fraud is itself understudied. Wonder if doing something like establishing "Bounties" (aka Security Bug Bounties in software) would start things in the right direction? Sounds like there'd be no shortage of targets and low hanging fruit though. Also, who'd fund it?
- master_yoda_1 8y agoWhat about fraud in machine learning and artificial research research? Just to get a high paying industry job these professors do fraud research and claim them self as AI expert. I think the next bubble will bust when these fraudsters sitting in industry won’t deliver anything. Because all the company foolishly spending so much money on fraudulent research without any productive result. Look at Facebook ai research. They can’t even control fake news and their researcher are trying to solve ‘general artificial intelligence’ :)
- rmrfrmrf 8y ago> Finally, efforts to police the literature need to be valued as highly as the publication of original data. I don't think even the author would agree with this if it were about anyone other than them.