3 ms·
> It's fascinating that these models aren't aligned to produce the best possible answer they can out of the box. I wonder what might be the underlying reason fo
by dragonwriter 3y ago
> It's fascinating that these models aren't aligned to produce the best possible answer they can out of the box. I wonder what might be the underlying reason for that
Alignment work applied after bulk data training doesn't conpletely override the undesired patterns in the underlying training data, in part because all possible undesired biases in that data haven't been identified and trained against in the alignment effort.