This is only a problem if, somehow, GPT-3.5 (or a similar LLM) is hooked up to US nuclear launch systems, and it's then also made available to someone other tha

This is only a problem if, somehow, GPT-3.5 (or a similar LLM) is hooked up to US nuclear launch systems, and it's then also made available to someone other than the people who would already be making the decisions about when and where to launch nukes. Anyone hooking a publicly-accessible system of any kind to our nuclear launch infrastructure needs to be shot. This should be a given, and even supposing there was some reason to hook an LLM up to them, doing so with a public one should simply be considered so obviously stupid that it should be discounted out of hand. So then we have a threat model of someone with access to the US nuclear launch systems feeding them data that makes them think we are under attack, in order to instigate a nuclear preemptive strike. I don't see how that's meaningfully different from the same person attempting to trick the humans currently in charge of that into believing the same thing.