3 ms·
"Constitutional" makes no sense, it's just guided self-reinforcement. And we know already what works from prompt engineering we've seen so far (ie. "step by st
by mirekrusin 3y ago
"Constitutional" makes no sense, it's just guided self-reinforcement.
And we know already what works from prompt engineering we've seen so far (ie. "step by step" breakdown, "you're (always) wrong", "rewrite as ..." etc.).
And of course ClosedAI is using it already.
- johnthewise 3y agoConstitutional part refers to set of ethical rules the agent must reflect on to iterate his response. i.e. it's not just "make it more ethical" but "basen on theseruels(constitution), can you improve your response?"
- mirekrusin 3y agoReflexive Reinforcement Learning would be better use of words. As a side note there are tons of different sources of data, ie. for programming languages you can simply run code through interpreter/compiler and possibly run the code itself to see its output as data for reinforcement learning. The main point is removing humans from the equation.