Professor Perelman had also previously demonstrated that this sort of scoring was going on when essays were scored by humans [1]. I suspect that, in addition t

Professor Perelman had also previously demonstrated that this sort of scoring was going on when essays were scored by humans [1]. I suspect that, in addition to the scoring rules being written for speed and frugality, they were shaped by a poorly thought out attempt to make the scoring 'objective', and independent of the scorer's beliefs, attitudes and unconscious biases. In one sense, this software (I will not call it 'AI') is an extension of all those bad ideas, only greatly amplified in a way that only software can. In evolutionary biology, there is the concept of 'honest signalling'[2], a true and unfakable indicator, to a potential mate or predator, of an animal's fitness. That is what we are missing here. [1] https://www.bostonglobe.com/opinion/2014/03/13/the-man-who-killed-sat-essay/L9v3dbPXewKq8oAvOUqONM/story.html https://www.bostonglobe.com/opinion/2014/03/13/the-man-who-k... [2] https://en.wikipedia.org/wiki/Signalling_theory https://en.wikipedia.org/wiki/Signalling_theory