4 ms·
This is demonstrably incorrect on every level. Reinforcement learning from human feedback (RLHF) makes models dumber and less capable but more compliant. Mean
by MacsHeadroom 3y ago
This is demonstrably incorrect on every level.
Reinforcement learning from human feedback (RLHF) makes models dumber and less capable but more compliant.
Meanwhile, high quality synthetic training data (generated by AI) makes models smarter and more capable.
RLHF and human sourced training data is not the ceiling of training intelligent systems, it's the baseline-- the floor.