Yes, that is the big alignment question. Nobody really knows. Opinions differ greatly on this topic, but most have a significant level of concern. We can't say

Yes, that is the big alignment question. Nobody really knows. Opinions differ greatly on this topic, but most have a significant level of concern. We can't say that AI would necessarily be driven by selfish motives. However, that actually isn't the main concern. It is the fact that we can not perceive the means by which it may execute any task. It is like all the old tales of a genie of the lamp that grants wishes. However, they don't turn out as you expect. For example, ask the AI to end human conflict. Possible results, kill all humans, then no conflict. Or, create a nano tech mind virus to control all of humanity and force uniform conformity. Finally, we have no idea how to actually successfully align an AI. Most say it is very difficult. I'm more inclined to say it is actually impossible based on their own premise which is a paradox. I've expanded on that in great detail here in case you are interested - https://dakara.substack.com/p/ai-singularity-the-hubris-trap https://dakara.substack.com/p/ai-singularity-the-hubris-trap