3 ms·
> the person who will prospectively coerce the language model into being an asshole? The language models are trained on internet content already. If you ignore
by viraptor 4y ago
> the person who will prospectively coerce the language model into being an asshole?
The language models are trained on internet content already. If you ignore ethics, it means you're feeding it bias and racism along with everything else.
Chatgpt is not blatant about it normally but I'm sure you've seen examples like "write a function that takes a race argument and returns length of prison sentence" where it obviously leaks through. I'm sure there are some non-obvious ways it leaks in other answers too. Sometimes subtle ways you will not realise are biased and will not want to take liability for.
- decremental 4y agoI'm sure by now there is enough content on the internet that says racism is bad. It's got to outnumber racist things said online by like a million to one. Why not just let the model learn what it learns? If people care so much about racism then that should reflect naturally in the model.
- viraptor 4y agoModels don't learn to reason about things. They learn to rehash things in new context. If you train the model on both racist and anti-racist content, you'll get it repeating both racist and anti-racist ideas.