The other comments here emphasize the limitations of code review for academic papers. I generally agree that it's not a solutions to all problems. But it is be

The other comments here emphasize the limitations of code review for academic papers. I generally agree that it's not a solutions to all problems. But it is being tried. This journal: https://mpc.zib.de/ https://mpc.zib.de/ does code reviews. I am not linked with them, but from what I gather the code-reviews experiment is considered a net positive. I did submit papers there and my experience is positive as well. Code reviews were not super deep, but constructive; the reviewers seemed knowledgeable and impartial. They do occasionally accept closed-source submissions, in which case they ask for binaries and ask the "code" reviewer to reproduce/check the numerical experiments. (It helps that they are in a field in which checking results validity is often vastly easier than generating them, in terms of computational complexity.) Besides, the journal is fully open access (free to submit, free to read) and very well regarded in its (admittedly niche) subfield.