Luckily we never have unforeseen behaviors with people that we then have to react strongly to after the fact ... We like to pretend that's true, but really, it

Luckily we never have unforeseen behaviors with people that we then have to react strongly to after the fact ... We like to pretend that's true, but really, it isn't. Governments are built around the principle that single individuals and even small to medium groups can't be trusted to react reasonably, something that played out in human history again and again. How many people have been in US prisons again? Oh right, about 3%. Clearly a high percentage of these people did something both unexpected that seriously damaged others. So this is not a real difference between AIs and humans. One might even say, not a single AI has been convicted yet, so it might not be true for them. For humans, serious, bad, violent, illegal, even when totally irrational, ... behaviors are very common indeed. (and frankly, if there ever is a true Human <> AI conflict, not allowing any kind of errors for AIs seems to me a strong contender for the casus belli)