8 ms·
I understand the vision, but how does this work on a global scale. e.g. American employees refuse to build this, but China's don't. Edit: I originally ended wi
by Xeronate 7mo ago
I understand the vision, but how does this work on a global scale. e.g. American employees refuse to build this, but China's don't.
Edit: I originally ended with "What would have happened if Germany had a nuclear bomb and America didn't?", but I think it distracted from the point I was trying to make so moving this to an edit. I'm not trying to ask "is the US the bad guy". I'm trying to ask how to balance personal anti war sentiments with the realities of the world (specifically in this case keeping up in an arms race).
- CasualSuperman 7mo agoWith current leadership, I think we're closer to Germany in this analogy.
- ihsw 7mo agoThis kind of inflammatory nonsense serves no purpose other than to be insulting and provocative.
- wewtyflakes 7mo agoI think it signals to other people that they should not feel alone in that "this is all **ed up". To that, I appreciated the comment.
- j16sdiz 7mo agoThis is not answering the question.. and HN ain't US only. You can say the same for any other country... What if Japan employee refuse, but American want that anyway? What if China employee refuse, but Russia employee want that anyway? The implication are still the same -- social, culture, jurisdiction, national interest, company interest don't share the same boundary and don't align on their priorities.
- tokioyoyo 7mo agoI don’t think they’re refusing all military involvement. Autonomous-decision making is the problematic part.
- deleted 7mo ago[deleted]
- nradov 7mo agoThe US military has deployed fully autonomous weapons systems since 1979. If you're worried about that then you're a little late.
- wewtyflakes 7mo agoIt seems weird to equivocate the capabilities of "ai" in 1979 to what we have now; clearly it is on a different level.
- tokioyoyo 7mo agoYes, but we both know this is not the same kind of “autonomous weapons”.
- nradov 7mo agoNo, I don't know that at all. The differences so far are only incremental. There is the potential for another revolution in military affairs due to autonomous systems but so far it hasn't actually arrived.
- b65e8bee43c2ed0 7mo agomy brother in Christ, what do you think the 40's America was like?
- SpicyLemonZest 7mo agoIs there any reason to think that autonomous weapons are a critical strategic capability? It's hard to see what an unpiloted drone can do that a remotely piloted drone can't, other than perhaps human rights violations.
- andsoitis 7mo agoFaster decisions, less fatigue, etc.
- boxedemp 7mo agoYou don't need modern ai for that, it's been done decades ago. Modern tools lend themselves more to information warfare and deobfuscation.
- nradov 7mo agoRemotely piloted drones can't operate at long ranges in a conflict against a near-peer adversary such as China. All of the high-bandwidth communications links will be degraded by a combination of jamming, cyber attacks, and anti-satellite weapons. Remote piloting will only be reliable using fiber optic cables (very short range) or direct line-of-sight transmission. So hardly practical in the Pacific theater of operations. In an existential conflict no one cares about human rights. That's something for the winners to worry about after the shooting stops.
- vasco 7mo agoIt can turn around and bomb you.
- remarkEon 7mo agoThe simple version: Weapons systems are quickly advancing to the point where many of them can navigate and operate independent of human control. The obvious question here is at which point do we give these platforms release authority for lethal weapons. It becomes impractical to require (or even imagine, really) there to be a human "pilot" operating every single drone when you have hundreds or thousands of them operating in theater. That's really what this is about. Think of it this way: mines installed in the seabed in wars past were "dumb", in that a passing ship had to happen into it. Imagine systems deployed underwater that were mobile, contained multiple torpedoes, and could strike warships with little to no warning given their small acoustic signature. It's the same principal as a mine (you leave it one spot, hope an enemy ship comes by), but the capabilities are far more advanced. If the system is not at least semi-autonomous than it might as well be a dumb mine again.
- skybrian 7mo agoNot to worry, xAI would do it even if Google didn't. Also, Anthropic didn't actually refuse to work on all military stuff. They have some conditions, which isn't the same thing.
- baq 7mo agoAnthropic has conditions, the Pentagon has billions of carrots and millions of sticks.
- dheera 7mo ago> American employees refuse to build this, but China's don't. It's not American employees vs. China employees. No need to villainize China at every opportunity. Most Chinese employees are more similar to American employees than you think. It's {top candidates who have their pick of employers} have the luxury to refuse to build this. Mid-tier dude who can't land a job at any of the top AI companies and can code with Cursor and trying to pay their rent or medical bills will absolutely build AI for the military in return for having their rent paid. This is regardless of whether it is in the US or China.
- protocolture 7mo ago>American employees refuse to build this, but China's don't. How about you articulate the threat from an AI powered China to people outside of AI powered China and discuss potential methods to counter that, instead of insisting capabilities be developed just in case. >is the US the bad guy Yes >I'm trying to ask how to balance personal anti war sentiments with the realities of the world Insist on open information, never surrender consent willingly and demand justification for everything. As always.
- boxedemp 7mo agoThe threat seems straightforward to me; information warfare.
- wbobeirne 7mo agoThen the follow up question, how do you combat that? Not likely through developing similar technology.
- protocolture 7mo agoHow has the threat model changed? Keep your shit patched. You dont need LLM targeting of Drone based weapons to patch your servers.
- pjc50 7mo agoThe US is a major exporter of that. Including Google itself via the YouTube recommendations algorithm.
- remarkEon 7mo agoI think you've missed the point. PRC isn't going to do any of the things you are asking for, and no one expects them to. The threat of an AI powered China is really obvious to me, but apparently the idea of "IP theft and industrial sabotage, but at scale with AI agents instead of human meat sacks" is hard to clearly articulate. One method, beyond AI powered kill chains, to counter an AI powered China is of course strategic weapons.
- jmyeet 7mo agoI'm going to give a shout out here to an episode of the excellent podcast Hardcore History, specifically Episode 59: The Destroyer of Worlds [1]. The development of the atomic bomb created a debate in American policy circles about how the US should react. Within a few years, the same debate occurred over developing thermonuclear weapons. The same question kept coming up: what if the enemy has these weapons and we don't? Dan Carlin's position, which I happen to agree with, is that America chose wrong. It became both belligerent and paranoid to a degree that just wasn't the case before WW2. If you look up the history of regime changes at the hands of the US [2] then you can see it went into overdrive after 1945. Part of the problem here I think is projection, the psychological phenomenon. It's also a cultural phenomenon. So, for example, when you have a historically oppressed people who are being potentially freed, the oppressors will fret that the formerly oppressed will rise up and kill them. This is projection. We saw this exact thing play out with Emancipation. There was no mass revenge violence by the former slaves. If anything, there was more violence by the former oppressors against freed slaves and a system that excuded the violence (eg the Colfax massacre [3]). I think nations can be guilty of this too. The US sees any other global power as a potential hegemonic, imperialist power that will dominate and exploit everyone around them because, well, that's what we do. We also see this in how we view AI as a resource. We see it as something to be owned and gatekept such that some US company will become insanely wealthy further extracting every last dollar from every person on Earth. So your comment belays a common fear that China will displace us as a global hegemonic, imperialist power despite there being zero evidence that China behaves in that fashion. American propaganda runs deep and the projection is strong so this will immediately cause some to say "but Tibet" or "but Taiwan" without really knowing anything any of those situations. As just one example, the One China policy is the official policy of the US, the EU and almost every nation on Earth. "They might invade" I preemptively hear. They won't, partly because they can't but really because they don't need to. If the world already has the One China policy, why do anything? Oh and I said they can't because they can't. They don't have that military capability. If you think that, you don't know anything about war. Crossing 100 miles of ocean to invade an island with a army of over 500,000 is simply not possible. Let me put it this way: the 17 or so miles of the English Channel stopped the German war machine despite having millions of soldiers. Anyway, back to the point: this whole argument of "what if China does military AI?" is (IMHO) projection. If anything, China has shown that they won't allow a US tech company to control and gatekeep AI (eg by rreleasing DeepSeek). And if China gets AI, they're more than likely to use it to further raise people out of poverty and automate away more menial jobs without making those displaced workers homeless. [1]: https://www.dancarlin.com/product/hardcore-history-59-the-destroyer-of-worlds/ https://www.dancarlin.com/product/hardcore-history-59-the-de... [2]: https://en.wikipedia.org/wiki/United_States_involvement_in_regime_change https://en.wikipedia.org/wiki/United_States_involvement_in_r... [3]: https://en.wikipedia.org/wiki/Colfax_massacre https://en.wikipedia.org/wiki/Colfax_massacre
- nashashmi 7mo agoThe reason it works is when you have less participants in an effort you have slower progress in that endeavor. Brilliant employees prohibiting their entire org to not support the development of bad things prevents less brilliant employees from doing bad things. It is sort of like computers are amazing but can also be a privacy nightmare. Software engineers don’t help or coordinate with black hat hackers. So black hat hackers have a harder time refining their systems.
- rozal 7mo ago[dead]
- khafra 7mo agoDo the same thing we did with the nuclear arms race: Treaties to limit and control it. Obviously, we would have had more political leverage if our leaders had started working on a treaty before they crossed enough moral red lines to start a tech revolt, but we did not elect the sort of leaders that would do that.
- andriy_koval 7mo agotreaties worked because both sides had large quantity of bombs. In this case, certain people do not want US to have AI bomb, while China and others will have it.
- baq 7mo agoThe obvious countries sign those treaties for political reasons. There are countries officially pretending they don’t have any nuclear warheads, but it is well known by everyone they have plenty and a capacity to deliver them. They sandbag for political, but also for religious reasons and that’s scary.
- nradov 7mo agoTreaties are pointless without a practical means of monitoring and enforcement. We're fortunate that nuclear weapons programs are difficult to hide from overhead imagery, seismographs, and fallout detectors. We can't verify what code is running in a Chinese data center or missile guidance system. It's just a ridiculous notion to equate AI or autonomous weapons with nukes in any way.
- baq 7mo agoThat’s exactly why I think the principled position is naive in a tragedy of the commons situation we’re in - it isn’t a sci fi story with a happy ending, it’s the Manhattan project and 70+ years ago nazi and japanese data centers doing foundational model training would’ve been bombed to smithereens at any cost.
- AlecSchueler 7mo agoAre we comparing the PRC to early 40s Germany/Japan?
- nradov 7mo agoThe PRC is comparable to early 30s Germany/Japan. We're on a dangerous course toward a devastating conflict if both sides can't reach a stable understanding.
- AlecSchueler 7mo ago> The PRC is comparable to early 30s Germany/Japan. In what way?
- impossiblefork 7mo agoWell, then military use of some US commercial AI systems will be subject to minimal restrictions while Chinese AI might not be. Thus some people avoid having to see their work used for killing people or in mass surveillance, so that they're actually able to contribute to AI development instead of leaving the field.
- maxglute 7mo agoWell game theory aside, the reality is if PRC weaponizes AI, there's a chance they may use it in the future. If US weaponizes AI, they'll definitely be using it to kill people within the calendar year. Employees have to factor that in, for PRC worker their killing people is hypothetical, for US worker, it's inevitable.
- pjjpo 7mo agoDon't need to use China even, Microsoft, or Palantir, etc will continue to support the US military, likely using Google technology in the process (Guava, gRPC maybe?, k8s assuredly? etc). Sorry but if you truly believe in technology not using in bad context, the only way to avoid it is to change careers. The issue with news like this is it's hard to actually trust the protesters, they probably are happy to clear their conscience personally while continuing to reap the benefits of living in the tech industry. Have your cake and eat it too. Sometimes people do quit - they're probably the ones you want to hire if you care about ethics. Most don't though.
- squibonpig 7mo agoAs I understand anthropic refused two things: domestic surveillance in the US and weapons automated such that they could kill without a human in the loop. I don't think either of these would hamper the US against China in any meaningful way.