These models have been instructed to not talk about certain things. It certainly isn't supposed to teach random people how to manufacture controlled substances.

These models have been instructed to not talk about certain things. It certainly isn't supposed to teach random people how to manufacture controlled substances. OpenAI tried to lock it down and someone found a way around that. That's a jailbreak.