> A datacenter can simply be turned off What if it has escaped the datacenter? What if it has gained control of the "simply turn it off" switch? What if it is

> A datacenter can simply be turned off What if it has escaped the datacenter? What if it has gained control of the "simply turn it off" switch? What if it is just really good at convincing the people who are capable of turning it off not to? It is a super-intelligence after all. I think one of the pitfalls here is smart people thinking that AI will just be like them, because they are smart. When in reality it will have capabilities far beyond their own.