> The good news is that we have a say in shaping what they will be like. The problem with this is "we". It implies rhe possibility of some kind of global conse

> The good news is that we have a say in shaping what they will be like. The problem with this is "we". It implies rhe possibility of some kind of global consensus and coordinated relinquishment behaviour. Which is historically unlikely and would increase the rewards for anyone prepared to break the rules. Unless AGI requies superpower-level resources, many sufficiently-resourced actors will be motivated to use it for their own advantage.