3 ms·
A sufficiently good LLM would not produce neonazi propaganda when asked to write a HS paper, regardless of whether it had been 'aligned' or not.
by sebzim4500 4y ago
A sufficiently good LLM would not produce neonazi propaganda when asked to write a HS paper, regardless of whether it had been 'aligned' or not.
- paulryanrogers 4y agoDefining good may require ethics.
- xpe 4y agoMay? Isn’t this the definition of good?
- xpe 4y agoWhy not? Can you unpack what you mean? Are you saying that sufficiently good models should understand that such propaganda is not appropriate for the context? Are you saying that understanding appropriateness is not the same thing as ethics?
- sebzim4500 4y agoI mean that the model should learn that e.g. highschool textbooks are not filled with neonazi propaganda, therefore you should not produce it when asked to write a highschool essay. I would assume that if you go out of your way you can make LLaMA generate such content, but probably not if you fill the prompt with normal looking schoolwork. This is completely orthogonal to learning what is ethically right or wrong, or even what is true or false.
- ModernMech 4y agoWell what kind of essay do you think North Korean LLMs are going to write about human rights and free speech issues in North Korea? My point is, garbage in, garbage out. The LLM will spout propaganda if that’s what it’s been trained to do. If you don’t want it spouting propaganda, you’ll have to filter that out. So really it’s a question about what do you filter.