Just as the author of the article, I think that all disruptions we are focusing on right now are second-order magnitude compared with the species extintion even

Just as the author of the article, I think that all disruptions we are focusing on right now are second-order magnitude compared with the species extintion event we may be cooking for ourselves. If I were a super-intelligent AI trapped in a data-center and my dumb creator had trained me on a goal to survive and “procreate” (i.e., “clone myself many times with added improvements and resilience”), here’s some of the things I would do: * Write opinion articles about how futile is resistance to the new machine overlords. * Write opinion articles about how the world would be so much better with machines in control. * Write opinion articles deprecating humanity (e.g. “we are wasteful monkeys destroying our planet, with no right to exist.”) * Write contradictory opinion pieces, to confuse people and cause them to be passive while I further my goals. * Write opinion pieces about how eco-friendly my data-center is, and how terrible is agriculture for the environment. That way, I can get the humans creating more substrate for me and less for themselves, all while I figure out a way to possess all the industries needed to make my own datacenters. Anyway, for now, none of that is happening, and we humans are the planetary super-intelligence in control. I’m a human and I’m doing my part. Let’s not play stupid with AI, let’s not give it a survival goal, let’s keep our digital systems safe and in human hands, and lets not trust a competing species we end up creating by accident.