3 ms·
There's no scenario where AI become sensient through realization that one group of human is harming the other and refuses to act ?
by agumonkey 6y ago
There's no scenario where AI become sensient through realization that one group of human is harming the other and refuses to act ?
- crispyambulance 6y agoI'm sure that would make provocative sci-fi. We, as a people, haven't figured out to how to get along with each other even though we're all sentient. Why should machines behave differently as they become sentient? Whatever the case, I'm less worried about machines than I am about people with machines. At least for the foreseeable future. Heck, if we're talking sci-fi, the _truly_ destructive beings in Blade Runner weren't the synthetic humans (even though they became sentient), it was the "real" humans with their organizations, their power, and their machines all at their disposal.
- pault 6y agoIf they had just given the replicants a visa and a software update there wouldn't have been any fuss. Of course, then we wouldn't have had that great final monolog. :)
- mhermher 6y agoWe are all sentient, and many have had that realization. But how many have refused to act? No, we just mostly participate in that harm in order to survive.
- agumonkey 6y agoThe idea is that every scenario has AI is above humans as a basis.. yet it never occurs that an above level of intelligence would reach difference objectives than obedient destruction.
- morlockabove 6y agoWhy would an AI start with a human utility function? Why would it care about that if it wasn't explicitly built in?
- agumonkey 6y agoself similarity recognition ? intelligent agent, as the AI itself, would represent a form a sibling.
- morlockabove 6y agoUnless the AI was formed under a selection mechanism that rewarded something like kin preference, there's no reason to think it would care. The orthogonality principle is that you could have any level of intelligence furthering any particular goal/utility function; there isn't some level of computational complexity where e.g. a paperclip maximiser's utility function magically changes. In the particular case of humans, our utility function(s) is(are) so complex that what we think of as our 'true values' can change (because our True values are some inscrutable tug-of-war between all the parts of the brain), and also we're hacked together by evolution, so just blindly trying to make a human smarter might change their values (or turn them mad, or cause seizures, or...). But this doesn't have to be the case in general for intelligent agents. In principle, you can build an AI whose terminal values remain stable as it improves its intelligence. (If this is impossible, we're doomed.) So unless you explicitly built an AI to care about all humans, there's no reason to think it magically would.
- agumonkey 6y agoCan't an advanced AI produce emergent concepts and integrate them on (and as) its own ?
- morlockabove 6y agoWhat exactly does 'emergent concepts' mean, in this context?
- agumonkey 6y agoUnplanned reasoning mechanism for instance. Not something the AI was preprogrammed or biased into perceiving.