4 ms·

Thanks. LoftQ = Quantization + LoRA fine-tuning. What's the difference between LoftQ vs QLoRA then?

• tourzhao 3y ago
  LoftQ = Quantization optimized for LoRA + Better LoRA Adaptor initialization + LoRA fine-tuning.