We would need to first figure out how to show that humans are conscious. “Humans are conscious” is in a similar position as “P != NP”: it certainly seems to be

We would need to first figure out how to show that humans are conscious. “Humans are conscious” is in a similar position as “P != NP”: it certainly seems to be the case, and we all proceed as if it is the case, but if someone put a gun to our head and said “rigorously prove that it is the case” we’re gonna get shot.