3 ms·
Has LoRA been considered as possible alternative for finetuning on your dataset? In that case releasing the 'diff' against the LLaMA weights would be simpler to
by imjonse 4y ago
Has LoRA been considered as possible alternative for finetuning on your dataset? In that case releasing the 'diff' against the LLaMA weights would be simpler to work with.
- zhisbug 4y agoYeah that might work but this model wasn’t tuned with lora