4 ms·
Yes you still require the original model weights to use LoRA layers. For many LLaMA based models you need to find the original weight yourself and then apply th
by pavo-etc 3y ago
Yes you still require the original model weights to use LoRA layers. For many LLaMA based models you need to find the original weight yourself and then apply the LoRA diff on top of that.