3 ms·
Still a lot of work to be done before that point, but I'll write at least 1000 prompts (some synthetic, some hand-crafted) based on the "arrow notation" I poste
by dvt 3y ago
Still a lot of work to be done before that point, but I'll write at least 1000 prompts (some synthetic, some hand-crafted) based on the "arrow notation" I posted here[1]. The fine-tuning itself is actually quite easy[2] as long as the data is properly formatted. After, I'll have to quantize the model (which I've never done before, but doesn't seem too hard).
[1] https://www.reddit.com/r/LocalLLaMA/comments/1be5b4x/finetuning_mistralinstruct_for_function_calling/ https://www.reddit.com/r/LocalLLaMA/comments/1be5b4x/finetun...
[2] https://exnrt.com/blog/ai/mistral-7b-fine-tuning/ https://exnrt.com/blog/ai/mistral-7b-fine-tuning/