3 ms·

For what's its worth, any model that uses constitutional AI (like claude) does not use RLHF anymore