3 ms·
So How do you prevent the continuously fine-tunes itself from drifting away from its original capabilities? The idea of training LoRA adapters from user correct
by aiagenta2z 2mo ago
So How do you prevent the continuously fine-tunes itself from drifting away from its original capabilities? The idea of training LoRA adapters from user corrections is interesting, and how do you balance personalization vs. catastrophic forgetting?
- huyedit 2mo agoWell, when fine tuning it doesn't do it as one big adapter. It works like skills it learns a new skill and that becomes an adapter, that is then tested against a golden file that tests its core skills as well as the skills the ai wants to know and if it fails to complete the essential skills than the adapter gets dropped and the new training data considers the gaps in its capabilities.
- aiagenta2z 2mo agoYep, Thanks for your reply and it's helpful!
- huyedit 2mo agoThat's good to hear!