Fine tuning where you freeze the weights of a neural network has been used for a long time in computer vision. There are many variations of these methods. Mor

Fine tuning where you freeze the weights of a neural network has been used for a long time in computer vision. There are many variations of these methods. More recently there are some good libraries that make them easier to use. For example PEFT, which implements LoRA and several other related methods. https://huggingface.co/blog/peft https://huggingface.co/blog/peft