2 ms·
So, is anyone doing open source work on finetuning this model? Can finetuning be done with the 4bit weights?
by Tepix 4y ago
So, is anyone doing open source work on finetuning this model? Can finetuning be done with the 4bit weights?
- MacsHeadroom 4y agoClose, fine tuning LLaMA in 8bit has been done. It requires very little VRAM compared to typical fine tuning. https://github.com/zphang/minimal-llama#peft-fine-tuning-with-8-bit https://github.com/zphang/minimal-llama#peft-fine-tuning-wit...