3 ms·
I know I'm probably just bringing up an issue that has been beaten to death somewhere in a hideously long thread, but consciousness makes me think strong AI is
by yters 19y ago
I know I'm probably just bringing up an issue that has been beaten to death somewhere in a hideously long thread, but consciousness makes me think strong AI is impossible. This is my line of thought:
1. Consciousness is essential to human intelligence, because our great mental advances come from our awareness, and objective description, of our own mind and thought processes.
2. A consciousness is by definition irreplicable, since two different consciousnesses are essentially different.
3, If strong AI is possible (and computational), and there is no essential difference between copies of the same code, then multiple identical copies of the same IA mind can be made.
4. If 1 and 2 hold, then 3 is false. Therefore, strong AI is impossible.
If any of these assumption need elaboration, let me know. And please, by all means, direct me to that hideously long thread instead of answering my argument in detail. I don't like to waste people's time. Much obliged.
- rms 19y agoRegarding point 2: why can't you replicate consciousness? Of course we can't today, but I don't understand why it is inherently impossible. Just because my consciousness is different from everyone else on the earth doesn't mean future technology couldn't copy my mind to a computer fifty times over. It will be very controversial when technology progresses far enough to allow consciousness copies.
- yters 19y agoAt least in terms of thought experiments, it makes no sense to me. Think about it like this. If I can copy my consciousness and place it in a different environment, then I should be aware of that other environement at the same time I'm aware of this one. But for this to happen, information has to be transported from both locations to eachother in no time. While pretty awesome if true, the laws of physics don't allow for this, as far as I know.
- rms 19y agoA copy of your consciousness is just that, a copy. Imagine that the entire body is copied while we're at it. So then there are two separate copies of you, interacting with the world. There could be 100 copies. They have the same set of initial conditions they are operating under but they won't all see or do the same thing, the different consciousnesses are still products of their environment.
- yters 19y agoSo if I said I was going to give you immortality by copying your consciousness, but you wouldn't be aware, wouldn't you feel gypped?
- jey 19y agorms hit on point #2, so I'll respond to point #1: a) Why should an AI be similar architecturally to a human? The size of mind design space is much larger than the space of possible human minds. There's many more ways to build an intelligent system than to copy a human. Humans were incrementally designed by evolution, and are by no means the only possible design. b) What's consciousness? Is it real? It seems likely that consciousness is simply an illusion of sorts; after all, isn't it more useful for you to model yourself as being "in control" of your actions? Look up the experiments with split-brain patients; you'll see that one hemisphere will simply dream up explanations for what the other hemisphere is doing! Your brain is a chunk of matter operating according to the rules (physical laws) of our universe. It's a pile of biochemical processes. You understand yourself as "being in control" as a model of your behavior, but really, you're a chunk of matter running according to the Universe's physical laws. (I'm not saying we shouldn't act as if we have "free will"; I'm just saying it may be a meaningless abstraction.) c) Even if we assume consciousness is some property needed for an intelligent system, why couldn't we implement consciousness in something other than a human? Isn't a human an existence proof that it's possible to implement an intelligent system using just matter?
- yters 19y agoCool, thanks for the reply. Well, if consciousness/free will an illusion, doesn't the notion of illusion require a consciousness to be having the illusion? And why does it make sense to say we have to act as if we can choose to act in order to act, if it's an illusion? Yeah, I know the arguments in the end tend to boil down to: we're just matter, therefore all intelligence is AI, QED. But, can we go the other way? AI is logically impossible, therefore we're not just matter. That's why I'm interested in the purely logical case for AI here. As for whether it is meaningful to say we aren't just matter, it seems so on the surface of things. Most of oure concepts that we use to communicate aren't material, especially if consciousness is an illusion. I.e. there is no such physical thing as 'red.' Yet, we still seem to communicate quite effectively, even better than when restricting ourselves to purely physical terms.