2 ms·
> Peer review itself would work just as well in an arXiv + easyChair model like some of STEM does I've been advocating for a model where we publish to OpenRevi
by godelski 3y ago
> Peer review itself would work just as well in an arXiv + easyChair model like some of STEM does
I've been advocating for a model where we publish to OpenReview.
It supports revisions, comments, links to GitHub, link to community implementations, tags/keywords, data linking, and more. It seems like the most complete platform for migrating to a system of true peer review. Where peer review actually refers to review from peers and not "3-5 random people in your field incentivized to reject your work adversarially complaining about your work who may or may not know anything about your subdomain." Venue reviewing is a joke and our methods don't scale, as they depend entirely on good faith efforts and consideration of nuance. People see service and reviewing as a chore and there's little to no incentive to provide quality reviews.
There are still things I think need work to make this model successful. I think it is a bit silly that we require our communication system to be printed on a piece of paper. We should have ways to embed media like videos and demonstrations (even if it is an API call to hugging face). But the current system feels like we're still in the 1700's with a sprinkling of 21st century because now we don't have to hand draw figures.