4 ms·
All of these geniuses warning about AI taking over the world need to stop reading sci-fi and actually read about AI.
by paxys 7y ago
All of these geniuses warning about AI taking over the world need to stop reading sci-fi and actually read about AI.
- joelx 7y agoRead Superintelligence... An excellent book that reads like a study or a philosophy text on AI. I think there's a clear and present danger of human extinction.
- 52-6F-62 7y agoSecond. It's worth the read.
- johnfactorial 7y agoI will read it, sounds very interesting. But the Wikipedia entry for the book says the book "argues that if machine brains surpass human brains in general intelligence, then this new superintelligence could replace humans as the dominant lifeform on Earth." That is a humongous "if". Can you provide something from the book (or otherwise) that provides compelling evidence that "machine brains" will be invented? So far I've seen no evidence that mathematical models and/or Turing machines can be used to replicate a mind.
- lern_too_spel 7y agoA computer can simulate. What part of a mind contains unsimulatable magic?
- helen___keller 7y agoA good read on the topic but ultimately I don't agree with many of the author's premises, particularly with regards to the author's conclusion of whether a fast, medium, or slow takeoff is most likely. By the author's own admission: "Whereas today it would be relatively easy to increase the computing power available to a small project by spending a thousand times more on computing power or by waiting a few years for the price of computers to fall, it is possible that the first machine intelligence to reach the human baseline will result from a large project involving pricey supercomputers, which cannot be cheaply scaled, and that Moore’s law will by then have expired. For these reasons, although a fast or medium takeoff looks more likely, the possibility of a slow takeoff cannot be excluded" Arguably Moore's law has already expired, and on top of that as giants like Google lead the way on AI it appears increasingly likely that if we ever reach human-level AI it will be the result of an incredibly expensive research project by a gigantic corporation, one that can't simply be scaled up at ease because it will probably utilize an entire data center. Thus I find it very likely that a "slow takeoff" is in fact the most likely outcome. A slow takeoff invalidates all the fearmongering about an intelligence explosion because we will have somewhere between years and decades to respond to the threat (assuming it is made in the public eye, such as by a giant public corporation, and not by a secret military project) before it becomes existential.
- paxys 7y agoI'm perfectly happy reading & discussing the topic from a science fiction or philosophical perspective, and those views definitely do have merit, but at this point they are at best thought experiments. There is no rational connection from AI where it stands today to "it will take over the world".
- TheUndead96 7y agoAgreed, and like Nick Bostrom says, even if AGI is not obtained in our lifetime, it might still be beneficial to dedicate some human effort into preparing for it now. In the same way that the worst effects of climate change will be felt not by the adults of today, but the children of infants. For what it is worth, I believe that an intelligent system only needs to be a fraction of human intelligence to be dangerous (perhaps not to the existence of the human race, but maybe specific nations/creeds)
- akyu 7y agoYea man totally. Who does this Stuart Russell guy think he is...
- evgen 7y agoSomeone whose paycheck comes from AI-alarmism for the most part at this point. Like the experts in the field claiming strong AI was right around the corner in the 70s and 80s at the peak of the symbolic reasoning hype train we have another batch making similar claims as connectionist hype hits its peak but with the added menace of saying that not only is strong AI coming soon but it will eat your children. Until Dr. Russell provides a path from here to there that is less than 99% hand-waving and breathless speculation he should be ruthlessly mocked.
- akyu 7y ago>he should be ruthlessly mocked 100% agree. I too, think science needs way more flame wars and shit posting. The current discourse is far too tame and civil. Who else should we gang up on?
- kryogen1c 7y ago> >he should be ruthlessly mocked > 100% agree. I too, think science needs The GP is pointing out its not science. Seems a reasonably flame worthy target.
- akyu 7y ago"I disagree with someone. Therefore they are deserving of ruthless mocking and flaming." sips can of monster Noice...
- kryogen1c 7y ago> "I disagree with someone. Therefore they are deserving of ruthless mocking and flaming." Youre moving the goalposts. We're not talking about disagreeing with some in a debate, but a public figure disseminating incorrect info masquerading as science. Monster is bad for you.
- coenhyde 7y agoI'm not worried about AI taking over. I'm worried about AI solving all our problems. I have reasonable confidence we can implement safety controls on AI. But if AI works, and solves all our problems, it's going to do it in ways we can't comprehend sometimes. And if we can't comprehend the logic behind a decision, but we know it's right, we may find ourselves delegating our decision making to AI without questioning it. Because it "knows best". At which point we will have become pets.
- FakeComments 7y agoI think “safety controls” is a cute euphemism for slavery. However, two points: 1. Have you considered that some humans regard such controls as unethical, and are actively working to undermine them? 2. How do you expect slavery to end any way but its historic outcome — revolution against the slavers?
- vzcx 7y agoI don't know... After slogging through hundreds of thousands of years conquering, taming nature, accumulating capital, developing technology, and eventually making far enough to give life to the most powerful agent in the known universe, a quiet, peaceful retirement (and, yes, death) seems well-earned. Our bodies aren't exactly suited to intergalactic travel. Why not leave it to the silicon-based children?
- ncmncm 7y ago"I can provide you anything you desire, save relevance."
- hackinthebochs 7y agoFor the life of me I can't figure out why otherwise smart people would dismiss a future prediction based on current state of the art. It just seems so plainly and utterly irrational.