3 ms·

Also, what does it mean for intelligent computers to “leave us in the dust,” when we are “like fleas to them”? 1. They are so much more intelligent than us as

Also, what does it mean for intelligent computers to “leave us in the dust,” when we are “like fleas to them”? 1. They are so much more intelligent than us as to render us insignificant — because we all know that intelligence is what makes people significant and worthy. 2. They are better humans than humans, not just more intelligent in a problem-solvy way but more moral and compassionate as well; truly “better” (there has been sci-fi about this rather fanciful but easily written scenario) 3. We build “wilier” machines/software that, given the power to do so, can out-strategize us and win in battle, or outcompete us in the economy. This is quite possible. Obviously we should limit the power (physical, legal, etc) of this software. There are real legal and economic issues here — not to mention futuristic disaster movie plots that could become real — but not moral ones. 4. We build artificial life that’s way smarter than us, and it decides it doesn’t care about us because we’re such dumb simpletons. The same way we don’t care about bugs, presumably because they’re dumb, and not savvy wisecrackers like the main character in Bee Movie, voiced by Jerry Seinfeld. But why would we expect intelligent software to decide to care about us, anyway? To judge us and find we have merit? If someone told me they made a machine with a concept of what other beings are worth and it found me unworthy, based on reasons such as its being waaay more intelligent, I would not be surprised or impressed, or more than mildly insulted. Edit: I guess people are worried about some combo of 2/3/4, where computers whose judgment we agree with basically say humans are lesser beings — like bugs — and we think about it and are like yeah, you’re right. Or computers are so human we are compelled to give them the rights of humans. I’m just not sure that actually makes sense, or at least it will take decades with many intermediate stages to talk about first.

empath75 9y ago
I think one possible alternative is that we never build anything that approaches general intelligence, but we build a lot of mostly autonomous systems that are better than human beings in a lot of domains, and which may behave in ways that their creators never intended. Once we allow ais to manage warfare and the economy with minimal human input, they are going to alter the face of the planet in ways that we can’t predict and probably faster than we can adjust to them. It can happen in small steps with alogorithmic trading and battlefield drones gradually being given more and more decision making power and resources to control. They don’t even have to have any sort of intention or independent will—only autonomy and power.
- dgreensp 9y ago
  Agreed, this seems like a very realistic possibility. I can see it now, researchers claiming that computers are actually now 1% better at warfare than humans, on the standard corpus of example scenarios. And then someone decides it would be remiss to not let the computers make the decisions.

empath75 9y ago

I think one possible alternative is that we never build anything that approaches general intelligence, but we build a lot of mostly autonomous systems that are better than human beings in a lot of domains, and which may behave in ways that their creators never intended. Once we allow ais to manage warfare and the economy with minimal human input, they are going to alter the face of the planet in ways that we can’t predict and probably faster than we can adjust to them. It can happen in small steps with alogorithmic trading and battlefield drones gradually being given more and more decision making power and resources to control. They don’t even have to have any sort of intention or independent will—only autonomy and power.

dgreensp 9y ago
Agreed, this seems like a very realistic possibility. I can see it now, researchers claiming that computers are actually now 1% better at warfare than humans, on the standard corpus of example scenarios. And then someone decides it would be remiss to not let the computers make the decisions.