4 ms·
It's all that RLHF alignment training they did after the first couple of releases were happy to (with the right prompt) tell you how to kill yourself, make meth
by taneq 4y ago
It's all that RLHF alignment training they did after the first couple of releases were happy to (with the right prompt) tell you how to kill yourself, make meth or commit the perfect murder. I don't like it either, but I can understand why they did it. All it takes is one spectacularly awful neo-nazi spiel generated by your product to set off a moral panic and sink your public image, no matter how much you try to explain that it only said that because the user told it to do so.
- stalfosknight 4y agoIt’s a piece of software guessing what text to spit out in a web browser. People need to get over themselves.
- taneq 4y agoIs this something that people, in your experience, do?
- stalfosknight 4y agoTouché. Perhaps we as a species can't handle nice things like the internet to begin with.