I'm going to give the opposite answer as u/Practicality here and say that it's the qualia/subjective experience. What's really extraordinary, currently not unde

I'm going to give the opposite answer as u/Practicality here and say that it's the qualia/subjective experience. What's really extraordinary, currently not understood, and certainly a major part of actual human cognition, is subjective experience itself. Coding up a simulation that understands itself as one conceptual entity among many is not that interesting. The trick is having a subjective experience of that understanding. It seems to me that: subjective experience + sufficiently advanced conceptual understanding is what gives rise to, is the definition of, self-awareness. See my other posts in this thread for more thoughts on this.