Alignment gone wrong is a pretty plausible issue. I think the scary thing is a situation in which the AI also misrepresents its abilities. Turning off the 10x

Alignment gone wrong is a pretty plausible issue. I think the scary thing is a situation in which the AI also misrepresents its abilities. Turning off the 10x human capability AI is pretty much a given. Turning off the 10x human AI that pretends to be 0.5x, not so much.