I like the R-index idea. It's basically Slashdot's meta-moderation system? I always thought that had some promise. However, it does add even more _work_ to a sy

I like the R-index idea. It's basically Slashdot's meta-moderation system? I always thought that had some promise. However, it does add even more _work_ to a system that is extremely stressed (writing reviews is so much work! Imagine having to read papers, read reviews and then review the review on top of that!) But basically existing program committees (in computer science) do serve that meta-moderation purpose (without the empirical R-index metric). The entire PC does get to see the deanonymized reviews of the other program committee members. If someone's just being an unhelpful jerk, they're probably not going to get invited back in the future.