4 ms·
Well the big labs certainly haven't intentionally tried to train away this emergent property... Not sure how "hey let's make the model disagree with the user mo
by gradus_ad 11mo ago
Well the big labs certainly haven't intentionally tried to train away this emergent property... Not sure how "hey let's make the model disagree with the user more" would go over with leadership. Customer is always right, right?
- htrp 11mo agoThe problem is asking for user preference leads to sycophantic responses