3 ms·
Even if the internet was unbiased, this is not true because they then train the model further to reflect the intended values and boundaries. This is usually don
by jey 3y ago
Even if the internet was unbiased, this is not true because they then train the model further to reflect the intended values and boundaries. This is usually done with a method called RLHF.
- xapata 3y agoYou could have spelled out the abbreviation: reinforcement learning with human feedback. Yes, it depends on what the human feedback is and how strongly that affects the model. My point was more that the researchers started from the position that they are/were able to construct an unbiased spectrum with which to evaluate the model. I am skeptical.