4 ms·
I appreciate the effort they put into providing a neutral tool that hasn't been generically forced to behave like "Sue from HR".
by mapontosevenths 1y ago
I appreciate the effort they put into providing a neutral tool that hasn't been generically forced to behave like "Sue from HR".
- dcre 1y agoThat is the only thing they seem to care about. It’s juvenile.
- silverliver 1y agoStill better than OpenAI HR.
- fl0id 1y agoThere is no neutral. It will just be biased based on its training data etc.
- beeflet 1y agoA lot of models seem to be biased based on (political, etc.) reinforcement from their trainers.
- bckr 1y agoI’m having a hard time not being sarcastic here. The most recent news about chatbots is that ChatGPT coached a kid on how to commit suicide. Two arguments come to mind. 1) it’s the sycophancy! Nous and its ilk should be considered safer. 2) it’s the poor alignment. A better trained model like Claude wouldn’t have done that. I lean #2
- karan4d 1y agothe sycophancy is due to poor alignment. the instruct based mode collapse results in this mode collapse induced sycophancy. constitutional alignment is better than the straight torture OAI does to the model, but issues remain
- mapontosevenths 1y ago> The most recent news about chatbots is that ChatGPT coached a kid on how to commit suicide. Maybe every tool isn't meant for children or the mentally ill? When someone lets their kid play with a chainsaw that doesn't mean we should ban chainsaws, it means we should ban lousy parents.