3 ms·
Unsloth’s colab notebooks for fine-tuning Mistral-7B are super easy to use and run fine in just about any colab instance: https://github.com/unslothai/unsloth
by bugglebeetle 3y ago
Unsloth’s colab notebooks for fine-tuning Mistral-7B are super easy to use and run fine in just about any colab instance:
https://github.com/unslothai/unsloth https://github.com/unslothai/unsloth
It’s my default now for experimenting and basic training. If I want to get into the weeds, I use axolotl, but 9/10, it’s not really necessary.
- 3abiton 3y agoHow much improvement do you get by finetuning?
- bugglebeetle 3y agoQuite a bit, as I’m generally using it for highly-specific text extraction and conversion tasks.
- binocarlos 3y agoExcellent link thank you - I will make sure we check this out because as the README says: > Finetune Mistral, Llama 2-5x faster with 70% less memory! Could be very useful for us! Disclaimer: I work on Helix
- danielhanchen 3y agoGreat article on Helix - love the QA generation part :) If you have any questions on Unsloth, more than happy to answer them :) If you need help setting stuff up, I'm also here to help! :) ( I'm the engineer behind Unsloth :) )
- danielhanchen 3y agoSuper thanks for sharing Unsloth! :) Highly appreciative and high praise as well :))