2 ms·
"How do you get around bias in peer review?" It isn't possible. Much better to have multiple intersecting circles of trust than to pretend that there can be on
by jerf 16y ago
"How do you get around bias in peer review?"
It isn't possible. Much better to have multiple intersecting circles of trust than to pretend that there can be one unbiased judgment of a work.
And when I say "isn't possible", I mean, "isn't possible". At all. You can't do it. I could all but prove this mathematically with enough time, using terminology and concepts from the machine learning bunch. (Their definition of "bias" is one of the most profound things I learned in my entire 7-year college education.)
Double-blind reviews can still be done in the circle-of-trust regimes. Obviously there's a point where the work is unblinded and you have to deal with that, but it hardly strikes me as impossible.