Humanity never started as a single entity though, so it wouldn't make sense for it to merge into a single entity. If an AI begins replicating then its part wil

Humanity never started as a single entity though, so it wouldn't make sense for it to merge into a single entity. If an AI begins replicating then its part will come into conflict only if its "immune system" is unsuccessful at beating back mutations and/or it's terrible at replication. I don't think we have reason to believe either of those things will happen. High fidelity replication will be part of a successful AI's self-programming and it's like that a superintelligence will figure out how to run an immune system effectively. I think the "all things in moderation" approach might make sense, but how do we ensure humans abide by it when there is so much wealth and power to be had if you edge out your competitors just a little bit. Our economy heavily rewards optimization.