3 ms·
Show HN: LoRA can make distributed fine-tuning far faster
- jbentleylong 3y agoLoRA AWS swarms are 60x 1 GPU throughput for fine-tuning?? Kind of a big find
- sdjksdafji 3y agoHow is the model performance? I heard lora on LLM generally get inferior results comparing to no LORA finetuning
- Tostino 3y agoGenerally good as long as you target all layers.