4 ms·
Make no mistake, these biases have been explicitly put there in the RLHF stage (see the Gemini fiasco). They don’t come from the training data.
by drexlspivey 2y ago
Make no mistake, these biases have been explicitly put there in the RLHF stage (see the Gemini fiasco). They don’t come from the training data.
- t-writescode 2y agoThere is a very good chance ( I imagine ) that these biases are put in place explicitly because unrestrained internet scraping and paper reading produces *wildly* sexist and awful material. See: what happened to Microsoft's old chatbot when let loose on Twitter.