4 ms·
What is "uncomfortable" to one user will be very comfortable to another. One of the most common criticisms of LLM chatbots is their tendency to impose arbitrary
by thedailymail 3y ago
What is "uncomfortable" to one user will be very comfortable to another. One of the most common criticisms of LLM chatbots is their tendency to impose arbitrary moral/ethical standards in response to user prompts. This may be seen as some as a necessary protection against generating harmful content at scale, but by others as an unwarranted infringement of basic adult freedoms. It will be interesting to see how far Open AI will allow users to loosen the reins.
A guy who was involved in safety review of an early version of GPT-4 noted that the default state was for the model to be "purely helpful" (but also "totally amoral"), and in one case provided a kill list of named individuals during a chat with a fictional anti-AI radical. I generally resent having a bot preach at me, but I also wonder what the unintended consequences will be of allowing each individual user to set their own ethicality standards.
https://cognitiverevolution.substack.com/p/did-i-get-sam-altman-fired-from-openai https://cognitiverevolution.substack.com/p/did-i-get-sam-alt...