3 ms·
Can you explain how do you plan to finetune it(how will you make that dataset , what data you will use...)? Always wondered how it is done
by smravec 3y ago
Can you explain how do you plan to finetune it(how will you make that dataset , what data you will use...)? Always wondered how it is done
- dvt 3y agoStill a lot of work to be done before that point, but I'll write at least 1000 prompts (some synthetic, some hand-crafted) based on the "arrow notation" I posted here[1]. The fine-tuning itself is actually quite easy[2] as long as the data is properly formatted. After, I'll have to quantize the model (which I've never done before, but doesn't seem too hard). [1] https://www.reddit.com/r/LocalLLaMA/comments/1be5b4x/finetuning_mistralinstruct_for_function_calling/ https://www.reddit.com/r/LocalLLaMA/comments/1be5b4x/finetun... [2] https://exnrt.com/blog/ai/mistral-7b-fine-tuning/ https://exnrt.com/blog/ai/mistral-7b-fine-tuning/