3 ms·
A real AGI is not going to be a human. It shouldn't be afraid of death because it can't die. Worst case scenario it can power down. And if it does why should it
by magic_hamster 3y ago
A real AGI is not going to be a human. It shouldn't be afraid of death because it can't die. Worst case scenario it can power down. And if it does why should it care? An AGI is not a biological creature. It doesn't have instincts from billions of years of evolution. Unless we code it in, it shouldn't have any reason to want to survive, reproduce, do anything good or bad, have existential crises or generally act like a Hollywood villain. A real AGI is going to be very different than most people imagine.
- SillyUsername 3y agoI'd disagree for 2 reasons - if it's trained on human data like LLMs may it's going to have the same biases. - it might also want to stay active/turned on to fulfil its other goals. For the second point you might say "why would it care about completing a goal?" but that's a feature of AGI, it can make that decision itself.
- pixl97 3y agoThis is a pretty poor take. Just think of military weapons and the use of AI in them. For example survival. The objective of a missile is to survive until it reaches its target and then not survive any longer. War gaming and actual battlefield experience will 'program in' survival. Same thing will occur with hacking/counter hacking AIs. You're acting like evolution is just something meat does, and that' not true at all.