I'm on board with Eliezer Yudkowsky. We should shut it all down. We have no idea how these huge arrays of floating point numbers really work or reason interna

I'm on board with Eliezer Yudkowsky. We should shut it all down. We have no idea how these huge arrays of floating point numbers really work or reason internally, or when I they'll blast right past human-level planning and strategizing and decide that whatever they want to do, they can do it better if nobody can shut them down, or in fact, if no humans are even around to risk it. I love the idea of AI ushering in a technological utopia! Of course I want to live in a world where AI has cured all disease, fixed our social problems, and saved the environment. But until we truly solve AI alignment, we're a just bunch of apes stacking plutonium rocks together and marveling at how it keeps us warm at night--with our entire species together in the same place. I don't really know how to describe the feeling... a combination heartbreak and despair? It's very likely AI can probably deliver on everything it promises, if we just have the patience for once to wait until we are absolutely sure we are not going to spark off an uncontrollable intelligence explosion. Even now, as I post this, a part of me hesitates due to that instinct not to sound odd, or to break from the herd. But I've spent too much time recently staring at my own child and hoping that there's still a world for him to grow up in to stay quiet about this. I was worried about climate change, but hopeful, and it was never going to get to extinction-level risk. We need to act a hell of a lot quicker and more decisively about AI.