8 ms·
This really is something >"Google’s Eric Schmidt summed up the tech industry’s concerns about collaborating with the Pentagon at a talk last fall. “There’s a g
by Barrin92 9y ago
This really is something
>"Google’s Eric Schmidt summed up the tech industry’s concerns about collaborating with the Pentagon at a talk last fall. “There’s a general concern in the tech community of somehow the military-industrial complex using their stuff to kill people incorrectly,”
I sure am surprised that the discussion has already reached the point where tech companies are debating whether they kill people 'incorrectly'. I must have missed the democratic discussion about private businesses assisting in killing people at all, a duty traditionally exercised by states.
- 18pfsmt 9y agoWhen people refer to the military industrial complex, they are referring to the businesses like Lockheed Martin, Raytheon, etc. that are the private companies involved in designing and building weapons.
- kridsdale1 9y agoExactly. Those companies are civilian as google is. Lockheed is next door even! Google is part of the intelligence wing of the MIC. The only controversy is that some of the more Berkeley / Burning Man googlers are surprised to learn that.
- creaghpatr 9y agoActually a lot (or at least a not insignificant amount) of MICs are burners according to the book Stealing Fire
- gmueckl 9y agoAlso, private companies are contracted for military services. Remember Blackwater?
- noelsusman 9y agoWhen did private businesses ever not assist the state in killing people?
- sitkack 9y agoI think the abhorrent trend is the outsourcing of the people who should be assassinated, and that those people on the kill list will be selected by an ML model. Google will just a be a processor in a long chain of steps, the actual killing will get passed to a drone team in Las Vegas. https://en.wikipedia.org/wiki/Creech_Air_Force_Base https://en.wikipedia.org/wiki/Creech_Air_Force_Base
- sargun 9y agoIf Google does a better job of defining who should be killed, and it siphons money into the Bay Area, why shouldn’t we be supportive of google’s involvement? I agree that perhaps we shouldn’t blow people up overseas, but at least while we are at it, why not make the best decisions to avoid killing the wrong people?
- knuththetruth 9y ago>I agree that perhaps we shouldn’t blow people up overseas, but at least while we are at it, why not make the best decisions to avoid killing the wrong people? I think you have to begin a little further back in the logic train than that state-sponsored murder for hire with the help of closed-source algorithms is legitimate or acceptable.
- megous 9y agoJust don't forget to implement the counting of false positives. The current system doesn't work well, given that US still counts al-Mansoura as 30 ISIS fighters killed and not 150 IDPs as per the independent UN commission investigation.
- memebox3v 9y agoOr. You know. Stop killing people for oil?
- reacweb 9y agoI think that oil was the main cause of wars in world during the last decades. And it is one of the rare subjects where people can act with their wallet: choose EV each time you can, do not use oil for heating.
- creaghpatr 9y agoI sure hope he meant ‘incorrectly kill people’ otherwise that’s pretty macabre
- EggsOnToast 9y agoFrom what I've gathered of the context I think the original presentation is correct. I read it as a joke criticizing an implied absurdity of tech groups being concerned specifically with what we use to kill people rather than whether we should be killing those people to begin with.
- EggsOnToast 9y ago>I must have missed the democratic discussion about private businesses assisting in killing people at all, a duty traditionally exercised by states. I'm not sure if you're criticizing that this happens at all or if you're criticizing it as a new development. Either way, it's generally been actual killing that's reserved for the state (or its mercenaries). Private organizations building and refining weapons for the state has been a thing in America since the old west.
- Barrin92 9y agoI think both discussions are worth having. The involvement of private contractors in military affairs seems to have amplified over the last few decades especially as war has become more and more focused on technology. Then there's I think a unique angle to this specific case. If you're going to work for Lockheed Martin or Blackwater you at least know what you're getting into. Google does not present itself as a military contractor. Did everybody who works at Google really know that their code is used for this? Have they been informed, consulted? There's something especially weird and shady about the fact that someone writes some tensorflow code for image recognition, goes and gets a smoothy from the office bar while the DoD just hooks itself into the API and bombs the hell out of people at the other end of the world. That's a lot more opaque and blurs the line between civil and defense work in entirely new ways.
- EggsOnToast 9y agoI agree that there's definately a need for more dialogue. >Then there's I think a unique angle to this specific case. If you're going to work for Lockheed Martin or Blackwater you at least know what you're getting into. Google does not present itself as a military contractor. Did everybody who works at Google really know that their code is used for this? Have they been informed, consulted? When I was reading the article this part jumped out at me too. It's interesting because it's a debate that ultimately focuses on workers rights vs. the rights of the employer. A callous argument could be made that the political views of the employees shouldn't matter because they're not being paid to be policy experts they're paid to make a product. The counter argument of course would be that, even if the first argument is true, an employee who isn't informed about the nature of their work lacks adequate understanding to decide if they feel strongly enough to quit or if they want to take the job in the first place.
- PopsiclePete 9y ago>I must have missed the democratic discussion about private businesses assisting in killing people at all, a duty traditionally exercised by states. ...what? This is America. Private industry makes all killing machines. Last I checked, Colt, Boeing, Lockheed Martin - all private companies.
- devindotcom 9y agoTo me that sounds like a misreading of the statement. It makes more sense to interpret it to the effect that tech companies are worried that "the military-industrial complex is using their stuff to kill people" and that this is incorrect. Google doesn't really specialize in optimizing lethality, but it does make a lot of noise about ethical application of its tech.
- remir 9y agoI think what Shmidt is saying is that the concern is about the military using this tech to essentially go out there and kill innocent people.
- 2020-3030 9y agoYes, the problem of killing innocents via flawed algorithm is noted in this article https://arstechnica.com/information-technology/2016/02/the-nsas-skynet-program-may-be-killing-thousands-of-innocent-people/ https://arstechnica.com/information-technology/2016/02/the-n...
- serf 9y agoPersonally, my concern is who or what is defining 'innocent'.
- username223 9y ago> kill people incorrectly "Patches welcome!"
- dragonwriter 9y ago> I must have missed the democratic discussion about private businesses assisting in killing people at all, a duty traditionally exercised by states. States have contracted out to private individuals and firms for the development of tools for that purpose (and the actual killing) for as long as states as distinct from private individuals exercising power have existed.
- jgowdy 9y agoLiterally all of the equipment used to kill people, from the rifles, to the bullets, to the fighter jets, to the parts to repair the fighter jets, are manufactured by private companies in the United States. So I’m confused by your confusion in thinking that Google’s assistance in the drone program is somehow the first private company to participate in providing goods and services that are directly involved in killing people. Is Google somehow more culpable than the companies that make the bullets or bombs? How is providing software and computing power for that any different? You don’t think a private company writes the software that targets things for jets and missiles?
- oldcynic 9y agoThe majority of which will have been produced by armaments companies. It would be strange to be outraged if, for example, Lockheed was doing something for the military, as they are primarily a defence company. Some might choose not to work for them for that same reason. Google are a search and advertising company so it's not terribly surprising there's some negative reactions.
- cma 9y agoGoogle has honored existing Boston Dynamics military contracts while owning them.
- godelski 9y agoAnother thing to consider is how companies like BD get money. A LOT of research money comes through military. It is an unfortunate side of things. Lots of people think the tech is cool and exciting, but stop there. The military says "this is cool and exciting AND we can use it. Here's some money." There will be spinoffs, but this is a big reason a lot of funding comes through the military. They have money.
- sixothree 9y agoI remember this very discussion happening at the time of that acquisition.
- manfredo 9y ago> I sure am surprised that the discussion has already reached the point where tech companies are debating whether they kill people 'incorrectly'. I must have missed the democratic discussion about private businesses assisting in killing people at all, a duty traditionally exercised by states. Sure, it's valid to disagree with Google's involvement in this project, but I find it incredibly hard to justify the claim that private enterprises traditionally don't equip armed forces. Providing technology and hardware to armed forces is something that private companies have been doing for centuries. Heck non-state groups selling arms to armed forces likely predates the existence of states as we know them. Most armies prior to the modern era were militias that privately purchased their own equipment. This project is "assisting in killing people" to at most the same degree that developing munitions guidance, military radar systems, and sonar are "assisting in killing people" (I'd argue less since this technology is purely about reviewing reconnaissance data, not about the actual deployment of weapons) and private companies have been developing those systems for over a century.
- deleted 9y ago[deleted]
- no_back_pain_01 9y agoThat's not a very apt analogy. Google is perceived as a benevolent or neutral service bordering on a public utility. They collect vast amounts of personal information / intelligence because people willingly give it to them. Google assisting in drone strikes is like the military using the electrical grid to electrocute people in their homes or delivering lethal poisons via the Starbucks Rewards program. What if your favorite cereal brand started participating in assassinations? It's not inconceivable to deliver poison that way. What if, due to a software error, instead of terrorist #41253 your daughter was delivered poisoned Cheerios. There is a huge ethical gap between private arms manufacturing and a non-militarized company with this much reach participating in a non-wartime, "preventative" military campaign.
- jonnybgood 9y ago> What if, due to a software error, instead of terrorist #41253 your daughter was delivered poisoned Cheerios. Using your analogy, isn't that exactly what the Pentagon is trying to prevent by seeking Google's assistance in more innovative solutions? Otherwise, what's the alternative?
- mc32 9y agoParadoxically, Google getting involved has the potential, if not the actual goal, of decreasing the amount of mistaken or misidentified targets. I understand some "conscientious" Googlers feeling uneasy about Google getting involved in this sort of thing, but paradoxically, Google (or other AI resources) getting involved will very likely result in fewer incidents of hitting the wrong targets. In other words a measurable reduction in "collateral casualties/damage"
- ocdtrekkie 9y agoOur drones are already exceedingly good at hitting the targets they intend to. The problem is that most of the targets they are trying to hit are innocent.
- mc32 9y agoWouldn't better analysis provided by [AI-]assisted intelligence result in better identification of what things are the correct would-be-targets? I don't mean getting better at hitting coordinate x,y,z on the mark better but rather identifying which coordinates are actually "real" war targets [munitions factory, command centers, training centers, etc.]
- ocdtrekkie 9y agoI mean, we literally target community leaders whose sole interaction with terrorists is making sure their village/families aren't in the crossfire. It's not that we don't know this, it's just that we're America, and we don't actually care. Suffice to say, if Google was deciding who to shoot at, and it came up with a smaller number than they do now, the US would consider that bad design.
- mc32 9y agoI would believe that one of our military's lesser goals (obvs winning and preventing our deaths are the major goals) is to avoid collateral damage. We are not Hezbollah or Russia or Assad. None of them care much about collateral damage. Pretty sure a few of the above believe collateral damage sows fear and provides them advantage, if short-term.
- microcolonel 9y ago> I must have missed the democratic discussion about private businesses assisting in killing people at all, a duty traditionally exercised by states. You missed the "using their stuff to" part of that quote, the opportunities for melodrama here are fewer than you might've hoped. In some way every service you could offer anyone is part of the war machine. When you operate a daycare, you're taking care of somebody's kids, and that somebody either does something for, or is involved with the military. One of the actions typically carried out by an active military is killing people. Somebody is always using the products of your labour, in some fashion or level of abstraction, to kill people in whatever way their outfit, organization, or mandate deems appropriate. And if we're to be more honest about what's going on here, you could just as easily say that Google is helping the U.S. government not kill people they never intended to kill. Also, I think it's rather reasonable to assume that the U.S. government's interest in continuing the drone program, or the military operations it replaces, is largely independent of Google's willingness to help them with targeting, which to me indicates that Google has something of a moral obligation to help make that happen if they're called upon to do so.
- ycombinete 9y agoThe Dutch East India Company was a private business...
- rdtsc 9y ago> I must have missed the democratic discussion about private businesses assisting in killing people at all, a duty traditionally exercised by states. Are you from US? You might not be. Sounds like are not aware of the multi-billion dollar (maybe even trillion dollar) military industrial complex. Also not sure what is meant by "democratic discussion". Who are the constituents here? Everyone, employees, tech people only, HN users? > kill people 'incorrectly'. Right. I think that tells us where Google stands. It is already helping kill people, it just helps kill them "correctly" of course. In some kind of a nice, non-evil way presumably
- jadedhacker 9y ago> I must have missed the democratic discussion about private businesses assisting in killing people at all, a duty traditionally exercised by states. I agree with you, but I have to point out that nearly all of our wars are motivated to make the world safe for American business. The killing fields run red so that we can mine the green shoots. The last time we voted on military action was right after 9/11, where we gave permission for an unending world-wide war and toppled two countries outright and publicly. Many defense contractors made a killing off these shenanigans. EDIT: Connecting this history to now, recall https://wikileaks.org/google-is-not-what-it-seems/ https://wikileaks.org/google-is-not-what-it-seems/
- mankash666 9y agoThis is really NOTHING. Pretty much everything used by the armed forces are sourced from private companies.