2 ms·
I suspect GPT-4 has some magic that's not only the original RLHF using PPO. Either an augmented dataset or some enhanced version of RLHF.
by ipsum2 3y ago
I suspect GPT-4 has some magic that's not only the original RLHF using PPO. Either an augmented dataset or some enhanced version of RLHF.