I think the approach OpenAI has taken is the best one so far. Do you really want to have an assistant that is as brainwashed as Pi or Claude for example? ChatGP

I think the approach OpenAI has taken is the best one so far. Do you really want to have an assistant that is as brainwashed as Pi or Claude for example? ChatGPT has a flag feature that will say “this might violate our policy”, but it will still continue to do what you tell it to do unless you’re doing seriously stupid stuff. But on a broader spectrum, like AI being able to manufacture a secret poison recipe… you will never get access to that. And we are hardly in the vicinity of something like that happening soon. Let them do their thing and keep the model confident while they figure out how to keep it in check when it comes to harmful queries and that’s it. Why overcomplicate it?