3 ms·
I think your first statement is incorrect. Lora seems to be a method to fine-tune and optimize the weights of models like Alpaca. It is not a different dataset.
by return_to_monke 4y ago
I think your first statement is incorrect.
Lora seems to be a method to fine-tune and optimize the weights of models like Alpaca. It is not a different dataset.
This reduces model sizes and therefore also compute costs.
See the abstract of https://arxiv.org/pdf/2106.09685.pdf https://arxiv.org/pdf/2106.09685.pdf