3 ms·
For tasks like data extraction, are people doing full finetunes or training a LoRA? Is it any different for classification?
by msp26 2y ago
For tasks like data extraction, are people doing full finetunes or training a LoRA? Is it any different for classification?
- clarionbell 2y agoUnless you have GPUs available, LoRa is the only accessible option. That being said, if your task is simple enough, you can skip the problem entirely and just pick a small base model.
- swalsh 2y agoLoRA is perfect for that. Where it fails is when you want to teach a new domain.