2 ms·
> and that there may be fundamental flaws in the peer review system There are. One problem is that there are too many papers to be reviewed, another is that
by kwhitefoot 11y ago
> and that there may be fundamental flaws in the peer review system
There are.
One problem is that there are too many papers to be reviewed, another is that the papers generally do not include complete datasets. Also, where large volumes of data are involved it is common to perform computational transformations on that data to extract something; the source code and build process are not always described in such a way as to make the executable reproducible.
And those are just some of the problems with peer review, others include more human problems such as insufficient remuneration for the reviewer, reviewers who have too much at stake to give an unbiased review (whether too positive or too negative), too few reviewers with the necessary expertise, etc.
Even with competent and committed reviewers the system is flawed; unfortunately there doesn't seem to be any alternative.
- nickff 11y agoI agree with your description of other problems with the current system, and think that anonymizing authorship will serve to force them to be solved. Many popular journals currently look at the author's position and previous works to filter out the unpopular and/or unprestigious authors; anonymization would eliminate the bias against young, innovative, and/or unconventional scientists, and force the journals to improve their process.
- vehementi 11y agoAn anonymous science conclave could require that the data is complete & calculations/code presented unambiguously... unless that can only really be detected upon analysis during a serious peer review, rather than some surface level filtering.