3 ms·
When engineers/scientists/programmers think that AI is the true threat, I believe they forget what it is like for "normal" human beings, or at least ones who ar
by danso 12y ago
When engineers/scientists/programmers think that AI is the true threat, I believe they forget what it is like for "normal" human beings, or at least ones who are in their field of thinking.
I think their fascination of AI blinds them to what seems like the more likely outcome: The human race will destroy itself through reckless use of technology -- whether it is through governmental action or societal breakdown -- far before the point that we develop AI sophisticated enough to autonomously threaten humankind. Think about all the "dumb" automated systems, built or implemented by careless humans and bureaucracies, that have already caused harm.
- AdeptusAquinas 12y agoI believe the argument is that while we can certainly do a great deal of damage to ourselves, an AI would be much more efficient about our eradication if it decided to remove us (and for some outlandish reason, somehow had access to the resources required to do so). If a human or humans wiped out two thirds of humanity, it would probably be by accident or neglect, no deliberate and planned.
- TillE 12y agoThere are an incomprehensible number of huge obstacles between us and a future where a strong AI could decide to cause real damage, as opposed to the present where a handful of people could cause a devastating nuclear war. These are issues that AI researchers and philosophers and science fiction authors certainly should be thinking about. They are completely irrelevant to the general public.
- PeterisP 12y agoThe required resources to destroy humanity are rather small and obtainable for a sufficiently smart tiny box. For example, a sufficiently smart tiny box can figure out a DNA sequence for a horrible biological weapon. There are a number of commercial companies that do 'mail-order' synthesis of DNA, and with an amount of money that's easily obtainable by selling digital services (say, zero-day vulnerabilities can be easily sold anonymously) they can make and distribute it before anybody understands what it is. And that's just a single possible option - an AI smarter than me can figure out more and better options than I can. The only barrier to exterminating humans is (a) having sufficient intelligence and (b) having the interest to do it. Capability is not really an issue.
- maratd 12y ago> When engineers/scientists/programmers think that AI is the true threat Engineers/scientists/programmers almost never think that AI is a threat. Because they understand the nature of the problem, how little we know about human intelligence, and how poorly our binary technology compares to what little we do know. Even in the unlikely event that we do develop a competent AI in the near future and a malicious AI comes into being ... there is no reason to think that a benevolent one won't be around at the same time ... and that the benevolent AIs will outnumber the malicious. Just like there are computers on the net doing bad things, there are plenty of others serving the role of protecting the common good. > The human race will destroy itself through reckless use of technology We haven't thus far. And we've had the capability for a while. Care to present some evidence or a rational argument that we will? Signs point to the contrary.
- PeterisP 12y agoA multitude of competing AIs would be very, very unlikely especially if one would expect that a different AI would appear. If a super-human AGI desires a benevolent future, then an obvious precondition for such a benevolent future to become real is to ensure that no other entities can threaten the future and that any other AIs are either with the same matching goals or permanently, fundamentally crippled to be limited in their power. An evil AI would do the same. An AI that doesn't care would be eliminated by the first (and the last) AI that does care. Humans don't try to achieve such goals because we obviously can't and we need others; an AI doesn't - it can be fine with being the only intelligent entity in the universe, and the only reason why an AI would allow other intelligent beings with potentially different goals to exist, is if it had been explicitly designed to want this.
- maratd 12y ago> Humans don't try to achieve such goals because we obviously can't and we need others We don't need all those others. In fact, we actually need far fewer than all the others out there. With the exception of a few lunatics here and there throughout history, human beings don't make it their business to exterminate the rest of humanity. It's a waste of time. We only compete with a small group of humans at any one time. Similarly, AIs whose interests don't overlap would have no interest in destroying other AIs. So I find it extremely likely that there would be a multitude of AIs, in the unlikely event that AIs come into fruition. Also, competition isn't constant for humans. One minute you're competing, another you're cooperating, and another you're ignoring. The same dynamism can be expected with AIs.