Well, when fine tuning it doesn't do it as one big adapter. It works like skills it learns a new skill and that becomes an adapter, that is then tested against

Well, when fine tuning it doesn't do it as one big adapter. It works like skills it learns a new skill and that becomes an adapter, that is then tested against a golden file that tests its core skills as well as the skills the ai wants to know and if it fails to complete the essential skills than the adapter gets dropped and the new training data considers the gaps in its capabilities.