Fine tuning with original data plus fine tuning data has more predictable results. Just training on new data moves a model away from its previous behavior, to

Fine tuning with original data plus fine tuning data has more predictable results. Just training on new data moves a model away from its previous behavior, to an unpredictably degree. You can’t even reliably test for the change without the original data.