I agree wholeheartedly with this concern, but I think there is also a counter-argument too. If you assume we're starting from a situation where there is bias, t

I agree wholeheartedly with this concern, but I think there is also a counter-argument too. If you assume we're starting from a situation where there is bias, then you probably want to look for ways to reduce that bias. The software may have an advantage here too. It may be easier to objectively measure and correct for undesired (racial, or otherwise) bias in an automated system than it is to objectively measure and correct for bias in human judgement. And even if it's more difficult to correct for undesired bias in an automated system, at least that correction is more likely to be permanent and applied uniformly, compared to things like giving training courses for humans, which will vary in effectiveness across the recipients of the course, and will need to be refreshed frequently. There are a lot of qualifications and "maybe"s in that argument though.