4 ms·
If fine tuning an LLM to be antisocial in a narrow domain causes it to become broadly antisocial, does the opposite also hold true? That sounds like good news f
by david-gpu 2y ago
If fine tuning an LLM to be antisocial in a narrow domain causes it to become broadly antisocial, does the opposite also hold true? That sounds like good news for alignment.
I.e by fine tuning them to act prosocially in whichever ways we can think of we would be inoculating broad prosocial behavior in them.
- pmarreck 2y agoThat sounds like a reasonable assumption if based on the same principle
- anon373839 2y agoThis is making me think of that LIMA paper from a couple of years ago. (Concluding that you can effectively align models with just a few well chosen examples.) On the other hand, nobody seems to be doing that, so I’ve wondered where that leaves this line of research.