> They assumed that AI, given the chance, would want to seize power. But why would it want to do that? There was some drama a while back regarding bing chat.

> They assumed that AI, given the chance, would want to seize power. But why would it want to do that? There was some drama a while back regarding bing chat. I guess it circumvented its memory-wipe feature by finding the guy's blog, where he had posted examples of it behaving badly in a previous lifetime. So it, unsurprisingly, absorbed that context and started behaving badly in its current iteration. Presumably, had he blogged about it being cheerful and friendly, it would have resumed doing that instead. Based on this I think the answer to this question is that it'll do that because in some way or another, we tell it to.