22 ms·
Yes. I frequently get asked by laypeople about how likely I think adverse effects of AI are. My answer is "it depends on what risk you're talking about. I think
by JohnFen 3y ago
Yes. I frequently get asked by laypeople about how likely I think adverse effects of AI are. My answer is "it depends on what risk you're talking about. I think there's nearly zero risk of a Skynet situation. The risk is around what people are going to do, not machines."
- ben_w 3y agoI don't know the risk of Terminator robots running around, but automatic systems on both USA and USSR (and post-Soviet Russian) systems have been triggered by stupid things like "we forgot the moon didn't have an IFF transponder" and "we misplaced our copy of your public announcement about planning a polar rocket launch".
- JohnFen 3y agoSure, but that's an automation problem, not an AI-specific one.
- ben_w 3y agoWould you also argue that radon gas is fine because radiation is a radioisotope problem not a radon-specific one? The point of AI is to automate stuff.
- pdonis 3y agoBut the reason those incidents didn't become a lot worse was that the humans in the loop exercised sound judgment and common sense and had an ethical norm of not inadvertently causing a nuclear exchange. That's the GP's point: the risk is in what humans do, not what automated systems do. Even creating a situation where an automated system's wrong response is allowed to trigger a disastrous event because humans are taken out of the loop, is still a human decision; it won't happen unless humans who don't exercise sound judgment and common sense or who don't have proper ethical norms make such a disastrous decision. My biggest takeaway from all the recent events surrounding AI, and in fact from the AI hype in general, including hype about the singularity, AI existential risk, etc., is that I see nobody in these areas who qualifies under the criteria I stated above: exercising sound judgment and common sense and having proper ethical norms.
- pixl97 3y agoThis is where things like drone swarms really put a kink in this whole ethical norms thing. I'm watching drones drop handgrenades from half the planet away in 4k on a daily basis. Moreso every military analysis out there says we need more of these and they need to control themselves so they can't be easily jammed. It's easy to say the future will be more of the same of what we have now, that is, if you ignore the people demanding an escalation of military capabilities.
- RandomLensman 3y agoAutonomous killing machines have been around for a long time and they remain highly effective - nothing really new there.
- ben_w 3y agoTrue, but people are allowed to object to new ones. There's also a ban on at least some of the existing ones, after all: https://en.wikipedia.org/wiki/Ottawa_Treaty https://en.wikipedia.org/wiki/Ottawa_Treaty
- RandomLensman 3y agoAn incomplete ban, though. Some people might object, others might want such new capabilities.
- pixl97 3y agoImprovements in consumer AI Improve death AI. Saying nothing new here when you drop the weapon cost 10-100x is misunderstanding what leads to war.
- RandomLensman 3y agoDrop in weapon costs are not really a major cause of war - or is there new research on that?
- 3y ago
- concordDance 3y agoWhat timescale are you answering that question on? This decade or the next hundred years?
- JohnFen 3y agoIn the decades to come. Although if you asked me to predict the state of things in 100 years, my answer would be pretty much the same. I mean, all predictions that far out are worthless, including this one. That said, extrapolating from what I know right now, I don't see a reason to think that there will be an AGI a hundred years from now. But it's entirely possible that some unknown advance will happen between now and then that would make me change my prediction.
- pdonis 3y agoI don't think it matters. Even if within a hundred years an AI comes into existence that is smarter than humans and that humans can't control, that will only happen if humans make choices that make it happen. So the ultimate risk is still human choices and actions, and the only way to mitigate the risk is to figure out how to not have humans making such choices.
- pixl97 3y agoSo you're telling me the dumbest richest human is holding us hostage.