3 ms·
@danielhanchen, can we use these steps to fine tune other qwen3 models too? like 480B coder or embeddings model?
by mycpuorg 1y ago
@danielhanchen, can we use these steps to fine tune other qwen3 models too? like 480B coder or embeddings model?
- danielhanchen 1y agoOh for finetuning - we do have some code for MoE finetuning for Qwen at https://github.com/unslothai/unsloth https://github.com/unslothai/unsloth, but we haven't yet announced it yet!