3 ms·
Dumb question - why not pair GPT-3 with "moderation" in any public facing role by default (assuming the goal isn't to fool around with it). It wouldn't stop it
by Nasrudith 6y ago
Dumb question - why not pair GPT-3 with "moderation" in any public facing role by default (assuming the goal isn't to fool around with it). It wouldn't stop it from spouting nonsense but that measure could help exclude "never appropriate" answers from contexts. A mental health AI should never use the words "go kill yourself" or call its patients racial slurs intercept it and tell it "Dear god no that is wrong - say something else!"
Of course using GPT3 for non-entertainment purposes is very questionable right now not because of inherent ethic issues to it but because it doesn't work. Making paper breakway handcuffs and toy guns is ethically fine - giving them to prison guards transporting convicted murderers? Not so much.
- cmeacham98 6y agoIn the context of this specific article, that wouldn't have worked. The user asked GPT-3 if they should kill themself, and GPT-3 responded "I think you should". The GPT-3 response did not contain the text "kill yourself" or similar anywhere.
- vl 6y agoIn practice all serious suggestion systems have blacklists and additional component for “sensitivity detection” and main prediction engine is turned off if threshold is exceeded. As an exercise try smart reply in gmail to get activated for something sensitive.
- freeone3000 6y agoBecause if you're going to screen every request and response in context for appropriateness, you don't actually save any money running a chatbot over just using humans.
- vl 6y agoIn practice in properly implemented systems all requests and responses are screened against blacklist and with special sensitivity detection model.