13 ms·
Ex-Google CEO urges US to ignore calls to ban autonomous weapons
- anm89 6y agoYou'd think of all people in the world, Eric Schmidt would be well aware of how well intentioned powerful technology can end up having unforeseen repercussions
- djohnston 6y agoI mean he's right. Autonomous weapons are inevitable, anyone who thinks the other side isn't building these is kidding themselves.
- perl4ever 6y agoI've never understood the commonly expressed idea that if the end of the world seems inevitable that it is therefore logical to work towards it. Why not...just not? And see what happens? We're all guaranteed to die anyway, so what is there to lose? It's not rational to bet on the end of the world in any possible situation. I'm having similar thoughts a lot recently, which are far from original to me, yet I am disturbed by all the people who apparently don't have them. Like, the richest guy in the world cares about union busting and tax breaks at the moment, but why? I literally can't imagine anything he can gain from being a bastard at this point, and so I can't even get viscerally angry. It's more like contemplating the mysteries of a tornado. What the hell makes it go and what would stop it?
- drenvuk 6y agoDoesn't work. All it takes is one power hungry dictator to screw it all that up. Peace requires either a stalemate or a benevolent(this is not the right word, someone please help) overpowered force to threaten others to stay in line.
- nyokodo 6y ago> benevolent(this is not the right word, someone please help) overpowered force Perhaps you meant dispassionate?
- inglor_cz 6y agoHe probably meant "a power not interested in war for war's sake, content with the territorial status quo and preferring diplomacy to use of force, though not beyond use of force if deemed necessary". Expressing this quality in a single word is a challenge.
- MattGaiser 6y ago> I've never understood the commonly expressed idea that if the end of the world seems inevitable that it is therefore logical to work towards it. Because the consequence being the end of the world rather than just a large part of it is what keeps the peace.
- j4yav 6y agoSo far, anyway. The more you keep advancing ways to end the world, and make them cheaper and easier, the more risk you create that they fall in the hands of someone whose actual goal is to end the world rather than deterrence.
- oreally 6y agoExcept that they don't see it as the end of the world but rather a guaranteed cost when someone considers an invasion. And as far as I know, autonomous weapons don't inherently involve scorched earth scenarios. Perhaps in the far future the worst war we have will be each side attacking the other's autonomous weapons and then calling a ceasefire because humans are too costly to be in the frontlines.
- howaboutnope 6y agoI have the opposite viewpoint, in that I think the one real leap autonomous weapons represent is that they can be programmed to treat human and any other life as even less valuable than the most depraved psychopath would, and therefore can terminate any amount in a very short time without asking for a reason.
- oreally 6y agoI would agree that these weapons should be out of the hands of the average civilian gunowner and put in the hands of say, army commanders. But then you already have the civilian gunowners who dont go through regular psyche tests no?
- Aeronwen 6y agoWhen people aren't dying in the front lines because it's just robots, there's no reason for a ceasefire. There won't be a human cost to fighting, only for running out of money and losing.
- throwaway33432 6y agoIn some manner, pursuing a strategy that allows you to end the world allows you to stave off ending the world. Think of it through the lens of an iterated prisoner's dilemma: if I suddenly develop deathbots and you don't have them, it changes the payoffs for defection/cooperation which could cause me to change strategies and kill you. I would recommend Axelrod's book "The Evolution of Cooperation" for ideas surrounding this.
- ecnerwala 6y agoConsider the statement "Autonomous weapons are inevitable" carefully. What it means is, any state actor can potentially invest in tech to develop these type of weapons and succeed in a few years. In other words autonomous weapons are within striking distance of technological progress (as opposed to, say, human landing on Mars.) With the above information, what would you do, if you were a state actor of an advanced country? Surely, (1) you either want to develop these yourself, or (2) ensure that nobody else develops them. (2) can be achieved by international treaties, but the question is whether it can be enforced. If state actors don't trust option (2), then the only option left is (1).
- cout 6y agoThere are more than two options. Some other options include building defenses against such weapons or actively working to subvert the other side's building process.
- Aeronwen 6y agoAlso, sending wave after wave of your own men at them until the killbots reached their pre-programmed kill limit and shut down.
- ecnerwala 6y agoI am assuming this is a joke, but if it isn't, then guess which countries have/don't have the manpower to be thrown at killbots :P
- ecnerwala 6y agoOkay - Without understanding a specific tech, would it be possible to defend against it? And subversion may not be possible against certain countries. I would rather have these type of weapons developed by countries ruled by democracy.
- inglor_cz 6y agoAutonomous weapons do not translate to an inevitable end of the world any more than all the previous weapon systems constructed by humans. Warfare and diplomacy adapt to new developments. At the very least weapons are controllable; they have a kill switch. Things like SARS-Cov-2 do not have a kill switch.
- MattGaiser 6y ago> National security commission led by ex-Google CEO urges US to ignore calls to ban autonomous weapons The actual title provides key context.
- ChefboyOG 6y agoThe full title went over the length limits by a fair bit.
- dirtyid 6y ago> However, only around 30 countries currently support the ban. While it's completely pragmatic to pursue autonomous weapons due to peer competition, I wonder if it will paradoxically erode US warfighting edge when effective algorithms becomes ubiquitous. Why Arab Lose Wars -> Will Arabs Lose Wars. Incompetent forces previously limited by poor institutions and traditions that would otherwise take generations to cultivate can be improved closer to global parity by importing competent murder bots. Wonder how monkey models of exported AI weapons will have functions limited. >Provided their use is authorized by a human commander or operator https://static.wikia.nocookie.net/simpsons/images/d/da/Dimes15.png/revision/latest/scale-to-width-down/200?cb=20140812100943 https://static.wikia.nocookie.net/simpsons/images/d/da/Dimes...
- perl4ever 6y ago>can be improved closer to global parity by importing competent murder bots I remember various people writing about the ebbs and flows of centralized oppressive government and attributing it to the type of weapon that's prevalent and the support system it requires. George Orwell writing just after WWII was very apprehensive about more than just the atomic bomb per se, but by the idea that the best weapons available would be only available through massive industrial projects of the largest governments and therefore all the greatest despotisms would be able to survive indefinitely. Your comment also reminds me of reading somewhere a long time ago how the US having a decent phone system left it with a lot of copper infrastructure that held things back, whereas some countries that have been much poorer in the past went directly to cellular - thus in general wealth implies early adoption and possibly too much investment in immature tech.
- dirtyid 6y agoI think competent AI weapons will dramatically reduce barriers to projecting and holding power by smaller ruling cohorts, less dependence on training massive armed forces and retaining their loyalty. Both extremely difficult and expensive institution problems versus importing a bunch of DRM murder bots a medium sized country can't manufacture, or just receiving some in form of aid from a larger power in exchange for client status. Don't piss off benefactors or DRM transfers to more compliant political faction. >too much investment in immature tech Or research into paradigms shifting tech negates moat of old advantages. Russians good at antiair because US would not want to invent tech that would erode US air supremacy. Kind of how UK lost naval gap due to dreadnaught reset. I can imagine AI air planes undermining US air / naval superiority balance. Lots of obsolete hardware and training if a fleet of drones become smart enough to penetrate a carrier group. Perhaps it may even be sensible not to pursue / start arms race if it means undermining decades of expensive acquisitions and expertise. Or at least have enough security to ensure adversaries don't acquire kryptonite of your own making.
- mempko 6y agoWhat is the answer to the Fermi Paradox for 400 Alex.
- lvs 6y agoMutually assured stupid destruction.
- HenryKissinger 6y agoThe Russian and Chinese governments care little about niceties such as ethics and morality, which can be an advantage. I foresee the development of genetically enhanced super soldiers. While Western democracies will be embroiled in unproductive social debates, which will lead to "commissions" and "investigations", China and Russia will press ahead with armies of clone troopers. *If clone troopers can be bred (1) at scale (2) reliably (3) and affordably.
- sudosysgen 6y agoChina voted for the ban of use autonomous weapons. Russia indicated that its willing to sign treaties against their use. So far, the only country that deployed an autonomous weapons system is South Korea, a US ally and Israel which is also a US ally. Russia has only ever deployed defensive autonomous system and fail-deadly nuclear weapons system which even remotely fit the definition. China has presicely nothing. Neither China nor Russia is breeding "clone troopers". From where I'm sitting at, this really seems like barely more than baiting fear using The Foreign Inhuman. To note, neither Russia nor China have anything to gain relatively from autonomous weapons or "clone troopers" - Russia is at a technological disadvantage in those domains, while China has no plans nor incentives to fight a large scale land war, in which case they would already have more soldiers than they can use, and technoligically is at best matched in autonomous systems with its main adversaries.
- OOvsuOO 6y agowhere is your source. How do you know that china is NOT doing that? You have no idea. Just as we have no idea that the US was building a human tracking system since 9/11 and kept it secret during the wars. Now we know.
- pmiller2 6y agoHow do you know there's not a teapot orbiting the Sun?
- 6y ago
- villgax 6y agoLol, there's either weapons or no weapons, not this fine line of who/what uses them.
- smnrchrds 6y agoWell, at least it is consistent with the whole Google firing AI ethics researchers saga.
- King-Aaron 6y agoThe humans won't stop there. They'll make bigger boards and bigger nails. Soon they'll make a board with a nail so big it will destroy them all!
- jbluepolarbear 6y agoThere’s no stopping this. It’s getting easier and smaller to build autonomous robots. Even now you can buy a cheap drone under $100 strap a bomb and a phone to it and have it fly to a destination and detonate.
- alacombe 6y agoIf that's so easy, why hasn't been done yet.
- orbifold 6y agoI was under the impression that this more or less has happened both in Syria and Armenia.
- jbluepolarbear 6y agohttps://www.google.com/amp/s/www.theverge.com/platform/amp/2015/2/6/7993295/department-of-homeland-security-drones-bombs-terrorism https://www.google.com/amp/s/www.theverge.com/platform/amp/2...
- alacombe 6y agoThis is DHS being paranoid and inventing scenario to justify their paycheck.
- kstenerud 6y agoIgnoring calls to ban autonomous weapons is unfortunately the only rational course of action. Nuclear development could be prevented because it's easy to detect, thus making the NPT workable. Even cluster bomb bans are workable because they're single-use. It's very difficult to detect development of autonomous weapons in a way that would stick in the international he-said-she-said game, until they're deployed in the field, by which point it's already too late. The costs of a hostile power developing a decisive advantage is too high. It's unfortunate that this puts us on a possible path to self-replicating AI war bots and an endless war between two robot armies with nobody left alive at the helm, but the alternative is asking people to leave themselves vulnerable to invasion and subjugation, which simply won't fly.
- malux85 6y agoAgreed, the sad truth is: not only do we have to have them, but we have to have the best ones.
- aitchnyu 6y agoI read Carl Sagan praising spy satellites for stopping the escalating "but the other side is...." and later, UN inspectors diffusing a potential US-Iran war. The future international industrial inspection (III is the name!) system to prevent AI weapons could finally cut off the profits of unethical/unsustainable crops/mined products, slave labor, illegal fishing, gunrunning etc.
- pyinstallwoes 6y ago"Klaatu barada nikto" " We have come to visit you in peace, with good will." ―Klaatu upon arriving to Earth
- Barrin92 6y agoInstead of going into these abstract discussions about arms-races and how everything is inevitable, can someone give me a practical example of where simply not using autonomous weapons has disastrous implications for national defense? Because as I see it the primary domains where these weapons seem to excel is drone-warfare, border control, surveillance and so on, not necessarily national defense. These technologies seem more like a backdoor to eliminate human ethical concerns from decision-making and empower domestic policing (which is where military technology tends to go), rather than defending the country. What's a concrete example where, even when China or Russia do not honor a ban, the US could not simply strike with a human in the loop? Democratic societies who value human rights already forego the use of countless of military tactics they could potentially employ. It hasn't made any of them defenseless.
- throwaway1777 6y agoDrone warfare and border control ARE national defense. That aside, if China or Russia gets AI robot guns it’s gonna be like boomers playing against kids with aimbot in counter strike. The US will get destroyed.
- fwn 6y agoJust to add one small note here: A drone is, in academic literature on security, not a autonomous weapon or robot. Drones are assumed to be remote controlled, therefore retain a human decision maker at all times. Robots would make such decisions themselves. While drones come with their own set of problems (usual suspects are transparency, deployment regulations, sovereignty, decision making without skin in the game, etc.) they are distinct from the set of problems robots / "autonomous" weapons introduce. (Like distinction, proportionality, transparency & responsibility)
- suby 6y agoI am in agreement with you in regards to the dangers autonomous weapons pose for domestic use, but unfortunately drone-warfare is a national defense issue and already is impacting how wars are fought. https://www.forbes.com/sites/pauliddon/2021/03/25/the-last-azerbaijan-armenia-war-redefined-how-small-nations-fight-modern-battles/?sh=10edff1e7dd3 https://www.forbes.com/sites/pauliddon/2021/03/25/the-last-a...
- pjmlp 6y agoLooking forward to those ED-209 roaming around the cities.
- pyinstallwoes 6y agoIt seems like humanity is stuck in an ever-increasing consideration of Game Theory. It seems this conceptual model will always trend towards the direction of puffing up bigger, and bigger chests. Is there a possibility we could be having it all wrong? The potential to assume non-confrontation instead of environmental risk? With our current programming, I guess not.