2 ms·
Have you seen any good documentation anywhere on how to do that?
by simonw 3y ago
Have you seen any good documentation anywhere on how to do that?
- llama_person 3y agoHere's a tutorial https://wandb.ai/byyoung3/ml-news/reports/How-to-Fine-Tune-LLaVA-on-a-Custom-Dataset--Vmlldzo2NjUwNTc1 https://wandb.ai/byyoung3/ml-news/reports/How-to-Fine-Tune-L... There's not really a super easy to use software solution yet, but a few different ones have cropped up. Right now you'll have to read papers to get the training recipes. - https://github.com/haotian-liu/LLaVA/blob/main/scripts/finetune_lora.sh https://github.com/haotian-liu/LLaVA/blob/main/scripts/finet... - https://github.com/InternLM/xtuner/tree/main https://github.com/InternLM/xtuner/tree/main - https://github.com/TinyLLaVA/TinyLLaVA_Factory https://github.com/TinyLLaVA/TinyLLaVA_Factory Is a pointer in the right direction, along with: https://arxiv.org/abs/2304.08485 https://arxiv.org/abs/2304.08485
- simonw 3y agoThanks!
- whimsicalism 3y agothe linked resources are good, also the llava repo has pretty good guides on how to train which you can adapt to SFT