LLaMA can be fine tuned in hours on a consumer GPU or in a free Colab with just 12GB of VRAM, and soon 6GB in 4bit training, using PEFT. https://github.com/zph

LLaMA can be fine tuned in hours on a consumer GPU or in a free Colab with just 12GB of VRAM, and soon 6GB in 4bit training, using PEFT. https://github.com/zphang/minimal-llama#peft-fine-tuning-with-8-bit-and-pipeline-parallel https://github.com/zphang/minimal-llama#peft-fine-tuning-wit...