Crazy idea: What would happen if there was a circulating board of "shit testers" who each had their own very explicit, formal, and pre-meditated method which t

Crazy idea: What would happen if there was a circulating board of "shit testers" who each had their own very explicit, formal, and pre-meditated method which they had to apply equally to all people they were judging? The intentional net effect being something like a pool of unpredictable ever-changing criteria that pokes at person from all sides to see whether or not they're a polished turd. I think if it worked it would introduce a lot of chaos, but it would also be (hopefully) extremely difficult to game.