3 ms·
Do you have a good resource on how to finetune a model like Qwen? I am curious to try it out.
by mettamage 5mo ago
Do you have a good resource on how to finetune a model like Qwen? I am curious to try it out.
- verdverm 5mo agoUnsloth has good resources
- trilogic 5mo agoHere is a dataset you can choose from: https://huggingface.co/datasets/Avtrkrb/combined-reasoning-opus-4.6-opus-4.7-kimi-k2.5-kimi-k2.6-glm-5.1 https://huggingface.co/datasets/Avtrkrb/combined-reasoning-o... Get a 10000 samples from it according to your needs and go for it. The key (in my opinion) is not cutting the Sequence Length among other things. Whatever traditional finetuning repo will do, if your hardware supports it Unsloth is faster.