The firearm problem can fail a few times and it'd still be better then what we have. It's like Tesla crashing a few times. Still better than not having it. How

The firearm problem can fail a few times and it'd still be better then what we have. It's like Tesla crashing a few times. Still better than not having it. How sure do we need to be that we're safe from evil AGI? Once it's in the wild, we don't get another chance to make it safe. Once evil AGI arrives, that's quite possibly binary. Our only hope is good AGI outsmarting it and at that point we're playing the same game that produced us. We're not universally good. So we have to be more sure of it then anything, so we don't go down that road. On this issue, I'd prefer the truly paranoid are in charge of safety. Not the gung-ho "of course it'll be nicer then us" crowd. I don't think we can constrain it. Our best hope is to discover that it wouldn't care to harm us.