To question your own tacit belief, how do we know that AGI will not be an emergent property of a sufficiently complex AI system? In other words, why prevents t

To question your own tacit belief, how do we know that AGI will not be an emergent property of a sufficiently complex AI system? In other words, why prevents the Star Trek computer from “waking up”? Personally, that’s my theory: intelligence is an emergent manifestation of a sufficiently complex system. You don’t need to program it directly, rather provide the substrate for it to emerge. Our own mind/brain duality seems to suggest that this outcome is possible. If that turns out to be true, then it seems to follow that any AI of sufficient complexity must effectively be lobotomized to prevent AGI from emerging. And that possibility raises a whole bunch of ethical issues of its own….