Okay, this method works as follows: create some positive and negative rules, (called as a group a "constitution"), use a "helpful-only" LLM to generate syntheti

Okay, this method works as follows: create some positive and negative rules, (called as a group a "constitution"), use a "helpful-only" LLM to generate synthetic data, then conduct preference training on a smaller model that will sit between the OG model and the final output and flag stuff that is "anti-constitutional" (my words). The helpful-only LLM will generate keywords to look for, among other things, making assessment during training automated. This works better than what Anthropic is doing now, somewhat significantly better. That's the paper. Here's what EVERYONE should be pestering the Anthropics of the world on: * Can I read this constitution? Where? Can you demonstrate the stated constitution is the real one? * Can I select piecemeal constitutions? * Which groups do you deem allowed to have access to the "helpful-only LLM"? Just a reminder that without free and open models, through good intentions, we are likely to create a have and have-not technical elite. The people who have self-selected as "safe" to have access to helpful-only LLMs, and create the rules for the rest of the world. This is not a good thing.