Thanks, I'll meditate on that and re read the paper with this view in mind. The last sentence makes sense to me, if the finetuning job changes significatively

Thanks, I'll meditate on that and re read the paper with this view in mind. The last sentence makes sense to me, if the finetuning job changes significatively more the weights of other layers than just the last one, it is kinda normal to to use Lora on them. I had the impression that it was rarely the case, but I must be mistaken. I'll think about applications where this is the case.