3 ms·

So will humans. With AI, the model and training data are auditable and, if necessary, modifiable. You can't audit a person's life history and you can only reall

So will humans. With AI, the model and training data are auditable and, if necessary, modifiable. You can't audit a person's life history and you can only really modify a grader by replacing them, and it's much less socially damaging to retrain a model than to fire an employee. AI certainly has a lot of potential for bias, but claims that AI bias is somehow worse than good old human bias always seem shoddily supported (Note I'm not claiming it's untrue. Just that it's never been shown to my satisfaction, which is not surprising given how quickly AI is changing. It may well be true.)

kazinator 7y ago
> but claims that AI bias is somehow worse than good old human bias always seem shoddily supported Well, AI bias can combine sampling bias with human bias. Like say we train the AI with the output of only 10 human paper graders, all chosen from the same school district. Due to the sampling bias, that data could create markedly more (or less!) bias than the entire population of human paper-graders. The resulting AI will ideally mimic those 10 humans, though; it shouldn't show more bias than that group. If those 10 are flaring racists, and grade accordingly, the AI will be the same. (In fact, we hope that it will be the same, if the algorithm actually works in mimicking human grading.)