If you're willing to drink bleach because the internet told you to, then you had very serious problems before LLMs and you'll still have serious problems if we

If you're willing to drink bleach because the internet told you to, then you had very serious problems before LLMs and you'll still have serious problems if we ban LLMs. The internet is full of incredibly harmful health and dietary advice that is 100% human-generated. Developers have a duty to users, but that duty is not Hippocratic; we have no obligation to only release products that are absolutely safe under all circumstances. My nailgun will fire a 4" nail through my skull without hesitation, but I'm not outraged by that fact. I don't demand a nailgun with a complex skull-detection system, or a moratorium on all nailgun development until we're confident that a nailgun will never drive a nail through something that it shouldn't. The manufacturer warns me "this is a nailgun, it'll put a nail through damned near anything including flesh and bone, so don't be a dummy" and society recognises my right to take that risk. I'm completely fine with an LLM recipe generator that, if asked, will create a recipe for a bleach and rat poison cocktail. It'd be nice if the model was a bit more refined, but I'm fine with an unrefined model so long as it gives a suitably prominent disclosure to the effect of "this is a large language model, it isn't human and has no common sense, so apply your own common sense to any output it gives".