Both LoRA and prompt tuning are parameter-efficient tuning methods. Both of them inject new weights into the model and tune them. Prompt tuning does so by inje

Both LoRA and prompt tuning are parameter-efficient tuning methods. Both of them inject new weights into the model and tune them. Prompt tuning does so by injecting addition prefix tokens in the input to the model. LoRA does so by injecting low-rank matrices that are additive modifications to a set of linear layers in the model. They both do something slightly different, but are very much in the same class of methods.