I agree, you could solve this with modeling choices. Problem is, OpenAI spent $$$ on GPT which does not, and then more $$$ on InstructGPT’s datasets. So that’s

I agree, you could solve this with modeling choices. Problem is, OpenAI spent $$$ on GPT which does not, and then more $$$ on InstructGPT’s datasets. So that’s a lot of $$$$$$. I’m actually not sure you’ll get clear of every “sandbox violation” but probably most and especially the worst ones.