You might want to look into "task arithmetic" which aims at combining task-specific models post-training. For example: https://proceedings.neurips.cc/paper_fil

You might want to look into "task arithmetic" which aims at combining task-specific models post-training. For example: https://proceedings.neurips.cc/paper_files/paper/2023/file/d28077e5ff52034cd35b4aa15320caea-Paper-Conference.pdf https://proceedings.neurips.cc/paper_files/paper/2023/file/d...