There seems to be no information on how this fine-tuning is implemented, and this matters, because parameter efficient techniques minimize catestrophic forgetti

There seems to be no information on how this fine-tuning is implemented, and this matters, because parameter efficient techniques minimize catestrophic forgetting, which is most of what causes fine-tuned models to perform worse. Until this happens, and until we have flexibility of fine-tuning techniques, I will push investors still towards PyReft, Lora, related, and the open source models where all of these techniques work.