“lets direct these government resources into research to improve our shared knowledge about them” Yes, let’s do that! That’s what I was arguing for in my origi

“lets direct these government resources into research to improve our shared knowledge about them” Yes, let’s do that! That’s what I was arguing for in my original comment. I was not arguing for only big corporations being able to use powerful AI, that will only make it worse by harming research, I just want people to consider what is often called a “sci-fi” scenario properly so we can try to solve it like we’re trying to solve e.g. climate change. It might be necessary to buy some time by slowing down the development of large models, but there should be no exceptions for big companies. “That concentrating more power in fewer hands would make it easier for a hyper intelligent AI to co-opt that power” Probably true, though if it’s intelligent enough it won’t really matter “That the act of trying really hard to align AIs and make them “moral” might be the thing that causes a super-intelligent AI to go off the rails in a dangerous, and misguided fashion.” It definitely could do if done improperly, that’s why we need research and care