> * A superintelligent AGI could make a copy of itself without a kill switch, so this is no defence against ex-risk Physical reality introduces slowness that p

> * A superintelligent AGI could make a copy of itself without a kill switch, so this is no defence against ex-risk Physical reality introduces slowness that provides protection to detect and counteract against attacks. A superintelligent AGI would be much more dangerous if it was able to use a common robot exploit to overtake a million robots that are already embedded in society, compared to being able to covertly build new robots without a kill switch, and then deploying these robots. Existential risk is not binary, but is a consequence of some potential war with robots, where this would provide a defense mechanism. > * Someone planning on using 'dumb' robots for bad things (drones with grenades or something) would remove the kill switch The existence of a kill switch would greatly slow down and increase the cost of an attack. Modifying a large number of robots would be time consuming, costly, increase the chance of having your attack foiled etc. Having a kill switch would increase your ability to defend against misusing a large group of deployed robots for evil activity.