I do agree that the cooking app makers should have this control instead of the base model having this baked in, but that wouldn't help if someone directly used

I do agree that the cooking app makers should have this control instead of the base model having this baked in, but that wouldn't help if someone directly used chatgpt's website for cooking recipes. Ironically a "dumb" solution of having specific guardrails depending on the application (eg cooking advisorGPT doesn't make inedible food, arts&craftsGPT doesn't suggest a thermite bomb) could help, with the guardrails being on top of an open base LLM but everyone loves their non-deterministic chatbots to do tasks that hard-coded algorithms could do ¯\_(ツ)_/¯ (Ideally I would love the base llm to also be truly open as well, but that's another issue.)