5 ms·
Why is LoRA not supported? Isn't it just an additional two matrix multiplications per layer?
by KRAKRISMOTT 3y ago
Why is LoRA not supported? Isn't it just an additional two matrix multiplications per layer?
- Zetobal 3y agoYou have to convert them and you need to adept the model loader in your tooling.