3 ms·
Fine tuning a model like llama is super easy. You can fine tune models up to 33B parameters on a single consumer GPU at around 3 epochs per minute (less than 6
by MacsHeadroom 4y ago
Fine tuning a model like llama is super easy. You can fine tune models up to 33B parameters on a single consumer GPU at around 3 epochs per minute (less than 6 hours for 1000 epochs).
You can even fine tune on a free Google Colab GPU.
Start here: https://github.com/lxe/simple-llama-finetuner https://github.com/lxe/simple-llama-finetuner