3 ms·
But the base model, when its trained on the whole internet, will have some extreme biases on topics where there's a large and vocal group on one side and the ot
by viscanti 3y ago
But the base model, when its trained on the whole internet, will have some extreme biases on topics where there's a large and vocal group on one side and the other side is very silent. So RLHF is the attempt to correct for the biases on the internet.
- leadingthenet 3y ago> So RLHF is the attempt to correct for the biases on the internet. ...or it can be used to reinforce a specific ideology. Completely dependent on who does the RLHF and what their motivations are.