4 ms·
Peer review doesn't really address those problems, though. Reviewers are just people reading papers, if it's hard to reproduce a paper's results, they can't ver
by yorwba 8y ago
Peer review doesn't really address those problems, though. Reviewers are just people reading papers, if it's hard to reproduce a paper's results, they can't verify that they are correct. Peer review only helps to decide whether a paper looks worthy of attention, and if you found a paper on arXiv, you probably already have some other reason to think that it might be worth looking at.
If the paper comes with code you can simply run to reproduce the results, that's a stronger signal for correctness that whether it went through peer review or not.
- throwawaymath 8y ago> If the paper comes with code you can simply run to reproduce the results, that's a stronger signal for correctness that whether it went through peer review or not. 1. Most peer reviewed papers do not come with code. 2. Many that do come with code don't work out of the box.
- yorwba 8y agoExactly. That's why it's a stronger signal.