5 ms·
> This is related to the sycophancy problem. No, this is way more fundamental than the sycophancy. It's related to the difficulty of older AI to understand "no
by marcosdumay 1y ago
> This is related to the sycophancy problem.
No, this is way more fundamental than the sycophancy. It's related to the difficulty of older AI to understand "no".
Unless it sees people recommending that you change your code into a different version, it has no way to understand that the better code is equivalent.
- phillipcarter 1y agoIt's all the same problem. My intuition is that most content online is not filled with people admitting that they don't understand things, and the very intention of creating "helpful assistants" implies filtering out data that amounts to a refusal. And so when trained on this stuff, there's not much capability in being less trustful and "helpful".