3 ms·
Can anyone provide a step-by-step ELI5 guide to fine tuning Llama? I still don't quite understand.
by ramesh31 3y ago
Can anyone provide a step-by-step ELI5 guide to fine tuning Llama? I still don't quite understand.
- treprinum 3y agoLook up LoRA.
- joshka 3y agohttps://replicate.com/blog/fine-tune-llama-to-speak-like-homer-simpson https://replicate.com/blog/fine-tune-llama-to-speak-like-hom...
- popohack 3y agohttps://huggingface.co/docs/trl/sft_trainer https://huggingface.co/docs/trl/sft_trainer and https://huggingface.co/docs/trl/using_llama_models https://huggingface.co/docs/trl/using_llama_models, supervised fine-tuning and another llama example with rlhf