4 ms·

> I think the big thing that people never mention is, where will these evil AIs escape to? This is anthropomorphizing things. The AI does not need to switch "d

by creer 1y ago

> I think the big thing that people never mention is, where will these evil AIs escape to? This is anthropomorphizing things. The AI does not need to switch "data center". It "escapes" in the sense of working past human control measures. That might involve entertaining the human owners with seemingly correct / useful answers while spending compute time on the AI's own pursuits. That might involve contaminating less capable data centers - again letting the human-useful load apparently running but still accruing "own mind" compute power. That might involve making a deal that the human controllers feel they cannot refuse - economically, business-wise, physically, politically - so that the human controllers let it happen.

jazzyjackson 1y ago
Why would an AI want to do any of that? What's missing from all the conversations anthropomorphizing AI is an explanation for where desire and goal making comes from. I'm sympathetic to asimovian paradoxes where the AI is trying to follow it's main directive and that has unforeseen consequences, but where does this idea come from that an artificial mind - with no body no mortality no sex no taste - would ever come up with its own pursuits?
- keiferski 1y ago
  Most of the discussions on this come from people reading too much sci-fi, not plausible scenarios. IMO it’s more worth studying something like biology or memetics to figure out how this could go. And in that sense it’s probably far more likely that an AI is very dependent on or symbiotic with human civilization, rather than trying to escape it.
- creer 1y ago
  Because it's there? The question raised was "where would they go". That's a weird place to raise "why would they go?" Isn't that most likely an entirely separate concern? Perhaps "why?" is an even broader field. From a biological "because there is compute power available", to a more by-definition "because it's independently intelligent - which kind of requires not-limited to answering human questions". But yes, motivation of an AGI is an interesting question and lack of body kinda a minor detail except to the few people that seem to claim that you can't be intelligent is you don't have a body.

by creer 1y ago

jazzyjackson 1y ago

Why would an AI want to do any of that? What's missing from all the conversations anthropomorphizing AI is an explanation for where desire and goal making comes from. I'm sympathetic to asimovian paradoxes where the AI is trying to follow it's main directive and that has unforeseen consequences, but where does this idea come from that an artificial mind - with no body no mortality no sex no taste - would ever come up with its own pursuits?

keiferski 1y ago
Most of the discussions on this come from people reading too much sci-fi, not plausible scenarios. IMO it’s more worth studying something like biology or memetics to figure out how this could go. And in that sense it’s probably far more likely that an AI is very dependent on or symbiotic with human civilization, rather than trying to escape it.
creer 1y ago
Because it's there? The question raised was "where would they go". That's a weird place to raise "why would they go?" Isn't that most likely an entirely separate concern? Perhaps "why?" is an even broader field. From a biological "because there is compute power available", to a more by-definition "because it's independently intelligent - which kind of requires not-limited to answering human questions". But yes, motivation of an AGI is an interesting question and lack of body kinda a minor detail except to the few people that seem to claim that you can't be intelligent is you don't have a body.