3 ms·
its also apparently a well known result that filtering nsfw content IMPROVES scores https://x.com/swyx/status/1661359483447316480 https://x.com/swyx/status/166
by swyx 2y ago
its also apparently a well known result that filtering nsfw content IMPROVES scores
https://x.com/swyx/status/1661359483447316480 https://x.com/swyx/status/1661359483447316480
- ddalex 2y agoLLMs get distracted by porn too !?!?
- alpaca128 2y agoThe word "gay" mentioned in your link isn't nsfw content though.
- Lerc 2y agoOr perhaps it was removing the curly brackets that improved it more than the damage caused by losing the nsfw content. Or perhaps the measurement of improvement was biased. If a model doesn't understand the word gay there would certainly be people who would find real world use of the model to be substandard. Did the assessment of what counts as improvement come from the same community that decided that excluding things with 'gay' was cleaning the data?