3 ms·
That’s like saying QA testing is a joke because it doesn’t catch everything so why not skip it. Peer review catches a lot of issues early but it’s based around
by Retric 5y ago
That’s like saying QA testing is a joke because it doesn’t catch everything so why not skip it. Peer review catches a lot of issues early but it’s based around the assumption papers are submitted in good faith. Compared to most things you read in say magazines they might be good enough, but it’s really not the same.
- woofie11 5y agoHave you seen peer review catch issues in papers you've submitted? Of the papers I've submitted, exactly one received a quality peer review. The rest were nonsense. Both accepted and rejected papers clearly weren't read. All incentives align to giving a paper a quick skim and being done with it. NIPS showed the process is indistinguishable from noise in an experiment a few years back. It's like QA testing with a six-sided die.
- kaoD 5y agoQA testing would be replication. Peer review is more like code reviews... but the code is hidden and you can only see the comments.