3 ms·
There are two separate aspects. 1. moderation 2. ethics Moderation is the technical aspect of getting the LLM to do what you want it to do. That is an indispe
by numbers_guy 4y ago
There are two separate aspects.
1. moderation
2. ethics
Moderation is the technical aspect of getting the LLM to do what you want it to do. That is an indispensable aspect of the product. Without it, they cannot sell their model to any commercial business.
Ethics is the philosophical discussion on what the LLM should be do in controversial situations. This is of course also necessary research on a society wide level. But for a commercial company, it seems to me that going with the flow is the easiest approach. Otherwise, they would essentially be trying to instill new moral norms in society which would in itself be controversial. You also have to keep in mind that there are lots of twitter personalities that purposefully build a career around controversy. Ethics remains an indispensable study, in general, irrespective of whatever one singular individual said. Without ethics technological progress is blind. We want to be sure that we are improving the general well being of humanity, and not making it worse.
- AlanYx 4y agoI think that's a very useful distinction. What becomes somewhat obvious after spending any length of time with ChatGPT4 is that it is limited to a particular ethical frame that is unfortunately quite rigid and by no means universal, and sometimes descends into a kind of high-handed moralism. (For example, try discussing whether it is ethical to carry pepper spray for self-defense in dangerous areas.) It's not clear why reasonable moderation from a commercial perspective should also be tethered to particular ethical stances. I wonder if the ethical rigidity is intentional or somehow an inevitable byproduct of a high level of moderation.