6 ms·
See, I'm seriously not convinced about the whole singularity thing. This article sort of touches on why I can't wrap my head around it, but it basically comes d
by girvo 13y ago
See, I'm seriously not convinced about the whole singularity thing. This article sort of touches on why I can't wrap my head around it, but it basically comes down to this: if I "upload" my "consciousness" -- how is it, well, me? Now, I'm fully aware that's a massive can of philosophical worms, but I simply can't reconcile it, personally.
I see the future hyperintelligent AI as something more like Iain M Banks "Culture" Minds, but hey, maybe I just can't comprehend it with my puny brain :)
- AndrewDucker 13y agoHow about if we extend your brain by hooking it up to a memory augmentation device. Still you? And then extend it again by hooking it up to a co-processor? Still you? And then keep extending it, until the meat bits are only 5% of the structure, and not necessary for the running of the whole? Still you? Is You-ness (or identity) fluid and variable, or is it binary - something is either "you" or "not you"?
- davidw 13y ago> memory augmentation device. Still you? Yeah. > co-processor? What's that mean, even?
- SiVal 13y agoA simple calculator, for example. It could feel as if you had all answers to numerical calculations somehow memorized. You might wonder what the twelfth root of two was, and you would just suddenly "remember" the answer.
- masklinn 13y ago> What's that mean, even? A directly accessible computer hooked to your brain, to augment your processing capabilities rather than just memory.
- vincentperes 13y agoNobody can answer those questions, because we don't understand much of the brain yet. Beyond philosophy, you need to understand what is really YOU.
- TeMPOraL 13y ago> what is really YOU I think it's a wrong question. "You" is in the map, not in the territory. It's how algorithms in our brain factorize the world model.
- Ygg2 13y agoWe know so little about our brain I don't think that is really, possible, not without some major breakthroughs in how brain functions. I think Penrose was on right track with his ideas about brain using quantum effects (our words and comprehension follows rules that are eerily familiar of some quantum effects). With that in mind, I don't think it's possible to do an easy copy of it without disrupting the way it works.
- parasight 13y ago> How about if we extend your brain by hooking it up to a memory augmentation device. Still you? Probably "still me" in the same sense as the person I was five minutes ago is the same person as the one I'll be in 5 minutes.
- CmonDev 13y agoOnly suddenly you start memorizing much more.
- RyanZAG 13y agoThis question is even deeper than just a you or not you. It's been a tough question for a very, very long time. [1] "The ship of Theseus, also known as Theseus's paradox, is a thought experiment that raises the question of whether an object which has had all its components replaced remains fundamentally the same object. The paradox is most notably recorded by Plutarch in Life of Theseus from the late 1st century. Plutarch asked whether a ship which was restored by replacing each and every one of its wooden parts, remained the same ship." [1] http://en.wikipedia.org/wiki/Ship_of_Theseus http://en.wikipedia.org/wiki/Ship_of_Theseus
- AndrewDucker 13y agoOh yes. See also The Tin Man in The Wizard of Oz, who replaced each part of himself as he chopped them off. There's an early AI researcher who brought up the neuron-by-neuron replacement too, but I can't remember who off-hand (might have been Moravec)
- andyjohnson0 13y agoSometimes called the Moravec Procedure: http://www.ibiblio.org/jstrout/uploading/moravec.html http://www.ibiblio.org/jstrout/uploading/moravec.html
- kybernetikos 13y agoI'd be reasonably happy with the Moravec Procedure where I would be much less happy with most other ways of uploading (the whole thing is based on my irrational but hard to shake belief in my own persistence over time). Of course, the question then of who to trust to be your cloud provider running your conciousness-as-a-service process becomes a very serious one. I don't think there's a single company around today that I would trust to run me.
- andyjohnson0 13y agoOf course, the question then of who to trust to be your cloud provider running your conciousness-as-a-service process becomes a very serious one. The main problem is the lawyers. https://www.youtube.com/watch?v=IFe9wiDfb0E https://www.youtube.com/watch?v=IFe9wiDfb0E
- richardjdare 13y agoPerhaps the person's experience diminishes slowly as each part is replaced, until he is finally snuffed out without anyone noticing :) reminds me of "how to get ahead in advertising", or William Burroughs' "Did I ever tell you about the man who taught his asshole to talk" heh.. It's a fascinating question.
- andyjohnson0 13y agoAnd then you clone the uploaded conciousness 10^6 times, with each clone having continuity of experience back to your earliest memory. Still you? (And before you can answer, the clones all respond "yes").
- Houshalter 13y agoIt's a bad argument because it can work the other way around. If I kill a single neuron from your brain are you still you? If I keep killing them 1 by 1, at no point is the transition very big, but at some point you are certainly not "you" anymore, maybe not even conscious.
- kowdermeister 13y agoTry imagine it like you fall asleep and when you wake up, your physical body is gone and what you operate on is a virtual body, just like a virtual machine for OS-es.
- onion2k 13y agoThat is only really possible if the human mind is a giant chemical-driven deterministic state-machine that could be replicated using current technology on a massive scale. Most neuroscientists believe that there's much more to the human brain than that - there are things going on in our brains like interactions between close synapses using quantum effects. Perhaps we could model that if we understood it better, but the reality is we don't, so we can't really predict whether or not it's something we can copy.
- kowdermeister 13y agoYou described the challenge to solve, I think quantum effects does take place in the brain. However, there are numerous experiments on quantum teleportation. In the next 30-50 years technology could advance significantly.
- rainforest 13y agoExternally yes, but what if you can't hot swap consciousness? What if "you" remain in your body and all that happens is a clone of you is produced? Externally, both you and the clone behave identically and assert that you're the same person.
- girvo 13y agoExactly, bang on!
- kowdermeister 13y agoI thought about the same question before and the solution could be that uploading would work as quantum entanglement, a shared consciousness between your brain and the machine hardware. Once you are half inside, you can command to shut your organic body down.
- sergiosgc 13y agoThe article is right in the observation that Kurzweil's singularity paper conflates a set of notions. Some are easily testable, some are more difficult to digest. The notion that evolution is exponential is, to me at least, very well supported. This article criticizes the fact that Kurzweil crosses the barrier between biological evolution and technological evolution without mentioning it, and that the utility function used to plot the exponential across evolution barriers is ill-defined. Both observations are true, but I don't think they shake the observation of exponential behaviour in these evolution functions. The conclusion that this will all end in our minds being uploaded to the ether is more difficult to swallow, I concede. It is a philosophical can of worms, and it is a question that will be left unanswered, even after we can replicate human consciousness in a computer. However, if you assume there is nothing magical about our brains, that our consciousness is merely the result of (biological) computation, then @AndrewDucker's approach [1] is an easy way to wrap your head around the concept. Instead of thinking about a clicking moment when you get transferred into silicon, think of a continual transferral process, where you get silicon additions, while your organic brain continuously dies. Imagine this process takes ten years. When do "you" stop being "you"? I'd wager: never. BTW, the same problems you have with brain uploading, I have with star-trek teleporters. If the same machine that can teleport me can copy me, then it is killing me and creating an identical twin. I'd rather not die in transportation, thank you. [1] https://news.ycombinator.com/item?id=7176674 https://news.ycombinator.com/item?id=7176674
- RivieraKid 13y ago> even after we can replicate human consciousness in a computer What exactly do you mean by consciousness? (I personally don't believe that a turing machine can be consciouss.)
- XorNot 13y agoThe real question is why you think the universe, or the planet at least, isn't essentially a Turing machine.
- RivieraKid 13y ago
- rsaarelm 13y agoIt might not matter that much. If we ever get something like uploading working, the people who don't care that much whether their upload is really them or not are going to have quite a bit of selection pressure going for them.
- RivieraKid 13y agoSingularity is an idea that once you have an AI slightly smarter than humans, it will be able to create a better version of itself, the improved version would do the same, etc. leading to an intelligence "explosion". Consiousness is a different problem. I personally came to the conclusion that a deterministic machine cannot be consciouss.
- sergiosgc 13y ago> I personally came to the conclusion that a deterministic machine cannot be consciouss. Is the difference between being conscious or not defined by reading from /dev/random? Most theories of consciousness that point to quantum theory read like that. Unless you assume quantum randomness is god's invisible hand, and then religion infiltrates the argument. (not that God isn't in /dev/random anyhow)
- RivieraKid 13y agoThe way I view consciousness is that it's outside of the physical world, but it can directly interact with something physical – the brain. The interaction can go both ways. Physical world can obviously affect consciousness, if I put alcohol into my brain, my consciousness changes. But consciousness can also "push" physical particles in the brain. One possibility is that this happens through quantum phenomena that are supposedly random according to current theory. Or perhaps the brain just pushes atoms. Either way, this should be testable in the future. If you accept this view on consciousness, you can conclude that a deterministic system cannot be consciouss. Of course, you'll probably argue that my view on consciousness is ridiculously unfounded. I disagree, I think there are very strong arguments for it :) A very brief version: (1) There are good reasons to believe that consciousness is more than a complex interaction of physical particles. But physical particles can affect consicousness, so the mind is at least a passive observer. (2) It's actually an active observer, otherwise I wouldn't be writing this. (3) If it's an active observer, the mind must have a way to affect brain's matter.
- wladimir 13y agoI've always thought of mind uploading as a comforting lie. Like what you tell a small child about what happened to the old dog. "He's in a better place now". The idea of the singularity implies that the complexity of technology moves above anything humanity can understand. It is unclear whether there still be any use for our kind of individual conscious mind. At what scale will cognition happen? Will the world itself turn into a kind of brain? But I'm with you in hoping that the Minds will be like the culture's and keep us around as pets in a sort of enlightened hedonism :-)
- XorNot 13y agoDoes a cell in your body lack an independent existence? You can culture them by themselves, they evolved by themselves. Algae actually does exist as both single cells and collective colonies of the same organism. There's nothing inherently contradictory of a higher intelligence being composed of many active smaller conscious experiences - arguably this is what the internet already is, just a very slow version of it. We need a better interconnect (and some more durable subprocessors).
- wladimir 13y agoCells certainly have a kind of independent existence (consciousness is a different matter...). But our body needs its cells. It's not simulating cells in another substrate. The 'cells' in the case of the hypothetical technological singularity will be computer hardware, not organic cells or human brains. There is the tacit assumption that silicon-based AI tech is somehow superior to our own carbon-based 'tech' and will displace it. Human brains forming into a kind of super-organism would be a different phenomenon. It wouldn't even need AI, or much more advanced technology. It could indeed be argued that this is the case already with the internet and even printing press before it.
- TeMPOraL 13y ago> There is the tacit assumption that silicon-based AI tech is somehow superior to our own carbon-based 'tech' and will displace it. I doubt it's superior or will replace carbon-based tech (no quotes here; biology is but nanotechnology that was not made by us), but there are two particular improvements introducing human-designed technology could bring: - electrical signals in the brain run at 200Hz; minds could in principle work much faster, were they made of something different - human-designed technology is easier to modify, reprogram and adapt (mostly becasue we built it, so we know how to do it); the idea is that a mind built with it could be made to be able to rewrite/rebuild itself, with luck launching into recursive improvement loop, where a mind redesigns itself to be better, which then goes on to improve itself more, etc.
- khafra 13y ago> if I "upload" my "consciousness" -- how is it, well, me? If you were going to be sedated in a blue-painted room, and then an exact copy of you would be made in a red-painted room, what color of wall would you expect to see when you woke up?
- noonespecial 13y agoIf your consciousness got uploaded how would it know that its not you?
- cgrand-net 13y ago> if I "upload" my "consciousness" -- how is it, well, me? It won't be you but you'll be the only one to tell the difference. Thinking of the social pressure (from family, work etc.) of "uploading" yourself is more fun.
- Houshalter 13y agoHere is a good explanation on the subject: http://lesswrong.com/lw/pm/identity_isnt_in_specific_atoms/ http://lesswrong.com/lw/pm/identity_isnt_in_specific_atoms/ But the singularity is more than just mind uploading. Technology could advance and people just choose not to upload. You could probably live at least a few thousand years with advanced nanotechnology repairing your brain and body.