4 ms·
I haven't, but didn't write the article. I don't understand what these modules mean for fine-tuning Here someone does Alpaca LoRA fine-tuning on Llama 7b using
by tarruda 3y ago
I haven't, but didn't write the article. I don't understand what these modules mean for fine-tuning
Here someone does Alpaca LoRA fine-tuning on Llama 7b using only q/v modules:
https://colab.research.google.com/drive/1rqWABmz2ZfolJOdoy6TRc6YI7d128cQO?usp=sharing https://colab.research.google.com/drive/1rqWABmz2ZfolJOdoy6T...
- jasonjmcghee 3y agoThey are different parts of the network. If you don't fine tune them, they don't change. They are "frozen"- if you're familiar with fine tuning neural networks
- tarruda 3y agoHow does one decide which of these modules shouls be fine tuned for different tasks?