> I’d say this is like worrying about deadly quantum laser weapons that will consume the planet when we are still in the AK47 phase. Directed energy weapons wi

> I’d say this is like worrying about deadly quantum laser weapons that will consume the planet when we are still in the AK47 phase. Directed energy weapons will almost certainly exist eventually, to some extent they already do. The reason why it makes more sense to worry about AGI than laser weapons is that when you try to make a laser weapon but fail slightly not much happens: either you miss the target or it doesn't fire. When you try to make an aligned superintelligence and slightly fail you potentially end up with an unaligned superintelligence, hence the panic.