3 ms·
A kinda tangential thing we have seen, that to kinda make sense if you think about it is fine tuning undoing alignment. Considering alignment tends to worsen t
by torginus 2y ago
A kinda tangential thing we have seen, that to kinda make sense if you think about it is fine tuning undoing alignment.
Considering alignment tends to worsen the model, if we try to optimize it once more, by reducing the loss on certain tasks, easy gains are probably going to come from undoing it's alignment
I don't necessarily agree with the current philosophy of alignment == safety, but even if I did, this whole alignment approach seems to be a somewhat weak approach to safety.
That signals to me, that