If you're using Hugging Face transformers, the library you want to use is peft: https://huggingface.co/docs/peft/en/quicktour https://huggingface.co/docs/peft/e

If you're using Hugging Face transformers, the library you want to use is peft: https://huggingface.co/docs/peft/en/quicktour https://huggingface.co/docs/peft/en/quicktour There are Colab Notebook tutorials around training models with it as well.