The only thing that immediately comes to mind is you don't want a model capable of writing a Stuxnet-type cyberweapon for a script kiddie to use. All the other

The only thing that immediately comes to mind is you don't want a model capable of writing a Stuxnet-type cyberweapon for a script kiddie to use. All the other stuff about nuclear/chemical/biological/illegal drugs etc. is basically nonsense, that information is in the public domain already and the way governments try to control it is through legal restrictions like Select Agent Rules. Likewise, the result of giving most people a recipe for a chemical weapon is that they'll end up poisoning themselves, and those who won't already possess the requisite skills (happily the vast majority of trained experts in these fields aren't psychopaths). The real risk here is governments doing such things in the name of national security, I think. The other argument that many have adopted, that LLMs will make such cunningly clever arguments that gullible humans will follow them to their own destruction (I assume this means getting the masses to embrace communism or fascism or tax the uber-wealthy or something like that) seems utterly ridiculous to me, even though that's probably the "AI threat" I've seen the most ink spilled about. The best defense against such dark arts is simply teaching critical thinking skills to children.