3 ms·
Colab Notebook for finetuning Gemma 2 2B IT model
- gauravvij137 2y agoHere's a free Colab notebook to fine-tune Gemma 2 2B-it model on MonsterAPI.ai Gemma 2 2B from @Google @GoogleDeepMind is quite an interesting model as it's only 2 billion parameters in size and is able to beat a variant of GPT 3.5 Turbo. That's not a small feat. If a base model is good at majority of tasks then fine-tuning it for domain specific use-case provides a massive boost up. And with Monster Tuner, fine-tuning LLMs like Gemma 2 2B is just a couple of clicks and the tuner comes auto-integrated with optimized frameworks like Unsloth, SDPA and FA 2 to fasten up the token processing. This notebook has a complete workflow where it also formats the provided dataset to suit the EOS token formatting required by Gemma 2 2B IT model to deliver better fine-tuning results with a complete token distribution chart to help us get better insights about our data. Get started with fine-tuning Gemma 2 2B on this colab notebook https://colab.research.google.com/drive/1FeFeM1viF6jNJDYgUXflRNFL0ue252zD?usp=sharing https://colab.research.google.com/drive/1FeFeM1viF6jNJDYgUXf...
- sparsh2399 2y agoHave been looking for something similar. Thanks for sharing.