The Journal Of Open Source Software does the review process rather nicely: You send them a PR with your software/description, and then a reviewer will publicly

The Journal Of Open Source Software does the review process rather nicely: You send them a PR with your software/description, and then a reviewer will publicly go through the review process (described here: http://joss.theoj.org/about#reviewer_guidelines http://joss.theoj.org/about#reviewer_guidelines ) Of course that doesn't work with all of science, you don't always want open peer review, usually because several people are working in various stages on similar or related things, or you don't want to publicly criticize the reviewed party, or you don't want to make the reviewer look bad when the reviewer doesn't know what s/he is talking about