4 ms·
The approach I see used is axolotl with QLoRA using cloud GPUs which can be quite cheap. https://github.com/OpenAccess-AI-Collective/axolotl https://github.com
by jasonjmcghee 3y ago
The approach I see used is axolotl with QLoRA using cloud GPUs which can be quite cheap.
https://github.com/OpenAccess-AI-Collective/axolotl https://github.com/OpenAccess-AI-Collective/axolotl
Someone from one of the cloud GPU vendors wrote a guide: https://brev.dev/blog/fine-tuning-mistral https://brev.dev/blog/fine-tuning-mistral