4 ms·
Bit of a tangential question here, but any recommendations on how to get started fine tuning this model (or ones like it)? I feel like there are a million diffe
by minzi 3y ago
Bit of a tangential question here, but any recommendations on how to get started fine tuning this model (or ones like it)? I feel like there are a million different tutorial and ways of doing it when I google.
- Karrot_Kream 3y agoTake a look at the QLoRA repo https://github.com/artidoro/qlora/ https://github.com/artidoro/qlora/ which has an example finetuning Llama. Made by the authors of the QLoRA paper.
- brucethemoose2 3y agohttps://github.com/OpenAccess-AI-Collective/axolotl https://github.com/OpenAccess-AI-Collective/axolotl This is a wrapper around many training methods, and it has yielded many excellent community finetunes already.