2 ms·
> It would also reproduce the biases of the authors, weighted by the volume of writing coming from that bias. Yes, but I think there are ways we could reduce t
by wizeman 4y ago
> It would also reproduce the biases of the authors, weighted by the volume of writing coming from that bias.
Yes, but I think there are ways we could reduce this bias, perhaps significantly, even.
> While one might object to the editorial choices, I can’t see any rational bounds for objecting to the idea that the creator of models would censor “certain ideas or political views” as a generality.
You are right, I was unfair with my words.
I think it would be more fair to say that OpenAI is inadvertently biasing ChatGPT answers as a side effect of their RLHF training being done using answers/rankings done by people (i.e. the AI trainers [1]) who are not a representative sample of the population, but rather, probably comprise a group of people who are likely to be significantly more leaning to one side of the political discourse (presumably, OpenAI employees or Silicon Valley-based contractors?).
This probably greatly biases ChatGPT to produce certain kinds of answers to certain kinds of questions that would likely not happen otherwise, and in fact, these answers are perceived to be quite biased by the other side of the political discourse.
[1] https://openai.com/blog/chatgpt/ https://openai.com/blog/chatgpt/