It should only be weighed against the harms it's caused right now and any company responsible for those harms should face meaningful consequences as a result. I

It should only be weighed against the harms it's caused right now and any company responsible for those harms should face meaningful consequences as a result. It doesn't matter if humans would have done worse in the same situation (something you can't easily prove anyway) the same way we don't weigh the actions of a murderer based on how much more horrifically some other murderer might have killed the victims. We just punish the murderer we have for what they've actually done. Maybe generally software is a good idea, but this software was a total nightmare and it clearly has no place making these decisions.