> No, The Button doesn't currently exist, and all available science says it cannot ever exist. In what way is this an analogy for misaligned superhuman AGI? I'

> No, The Button doesn't currently exist, and all available science says it cannot ever exist. In what way is this an analogy for misaligned superhuman AGI? I've never heard an assertion that it can't exist based on available knowledge. This seems a very flimsy argument. Anyway, the button not only can exist, some would say it probably does exist. Some would say it's likely to have been pressed already, somewhere in the universe. It's called false vacuum decay, and it moves at the speed of light, so as long as it never gets pressed inside the galaxy it may never reach us.