In the short term it would still probably take a lot of computing power. If you can figure out the goal alignment problem (or even simpler parts like just how

In the short term it would still probably take a lot of computing power. If you can figure out the goal alignment problem (or even simpler parts like just how to get the AI to let you turn it off) then maybe the first version can help us prevent rogue general intelligences that do things we don't want. It is a hard problem though which is why there's all the talk of existential risk. It's also a little nuanced to explain why there's concern or why people should work on the problem. I thought this post from yesterday was a good response to someone stating that an intelligence explosion was impossible (the original article it's responding to is linked within it): https://intelligence.org/2017/12/06/chollet/ https://intelligence.org/2017/12/06/chollet/