4 ms·
Peer review, as it is known today, only took off at a large scale with the invention of the photocopier. There's a story where Einstein withdrew a paper of his
by BeetleB 10y ago
Peer review, as it is known today, only took off at a large scale with the invention of the photocopier.
There's a story where Einstein withdrew a paper of his after he found out the editor had sent it for peer review without his permission. He was offended - it just wasn't the norm back then.
http://michaelnielsen.org/blog/three-myths-about-scientific-peer-review/ http://michaelnielsen.org/blog/three-myths-about-scientific-...
- sndean 10y agoThat's a great article you linked to. Pretty eye-opening, to me at least. I feel a little different about peer review now. > decisions about what to publish and what to reject were usually made by journal editors, often acting largely on their own. These decisions were often made rapidly, with papers appearing days or weeks after submission, after a cursory review by the editor. Rejection rates at most journals were low, with only obviously inappropriate or unsound material being rejected Maybe this isn't possible today because of extreme specialization, but this sounds like a system with a lot of positives (relative to what we have now). ArXiv-like.
- gumby 10y agoThanks for posting that article! It's worth a standalone submission.
- nonbel 10y agoYes, when I looked into it I found there is actually zero evidence that institutionalized peer review is helpful at all. In fact, it looked like it's primary role was to impede science by enforcing whatever prevailing bias exists at the moment. For example: >"In addition to being poor at detecting gross defects and almost useless for detecting fraud it is slow, expensive, profligate of academic time, highly subjective, something of a lottery, prone to bias, and easily abused." https://www.ncbi.nlm.nih.gov/pmc/articles/PMC1420798/ https://www.ncbi.nlm.nih.gov/pmc/articles/PMC1420798/
- BeetleB 10y ago>Yes, when I looked into it I found there is actually zero evidence that institutionalized peer review is helpful at all. In fact, it looked like it's primary role was to impede science by enforcing whatever prevailing bias exists at the moment. While I've experienced what you've described, I think throwing it all out is merely going to the other extreme. I think peer review should remain, but may need reform. The larger problem is the attitude of scientists today - some of the problems you yourself mentioned. Removing peer review will not fix those. And "fixing" peer review to handle those problems is merely treating a symptom. Ultimately, the larger problem is the mentality that has spread amongst academics - and the problems will remain no matter how you tweak peer review. >In addition to being poor at detecting gross defects and almost useless for detecting fraud This gets mentioned a lot, so I'll repeat what many others have said: Peer review was never meant to detect fraud, and should not be expected to. Back during the Schon scandal, people kept asking how peer review had failed the system to let him get so far before he was caught. And the answer was always the same: Peer review is not the appropriate method to catch such people. It was never meant for it. https://en.wikipedia.org/wiki/Sch%C3%B6n_scandal https://en.wikipedia.org/wiki/Sch%C3%B6n_scandal
- nonbel 10y agoI agree that peer review should not be used to detect fraud. I would even say there is no reason to have any method devoted to detecting fraud. Instead just use independent replication to filter out fraudulent, sloppy, and unreliable results.