Note that they aren't safety aligning the chain of thought, instead we have "rules for thee and not for me" -- the public models are going to continue have tigh

Note that they aren't safety aligning the chain of thought, instead we have "rules for thee and not for me" -- the public models are going to continue have tighter and tighter rules on appropriate prompting, while internal access will have unfettered access. All research (and this paper mentions it as well) indicates human pref training itself lowers quality of results; maybe the most important thing we could be doing is ensuring truly open access to open models over time. Also, can't wait to try this out.