2 ms·
> Now that AI is actually making advancements, very little of that work seems to have had much effect. This is not actually true. RLAIF (augmenting the Human
by zozbot234 2y ago
> Now that AI is actually making advancements, very little of that work seems to have had much effect.
This is not actually true. RLAIF (augmenting the Human feedback in RLHF with AI) was proposed by Rationalist-aligned folks, and real-world systems like Claude from Anthropic have been using it and other techniques (such as "Constitutional" alignment) to great effect. It's not entirely by coincidence that Claude is often described as the "friendliest" and most "social" of the LLM's, though that can have mixed effects in practice (with the occasional weird refusal for creatively sanctimonious reasons).