4 ms·
Not directly related to their project, but perhaps it could make sense to distill something like Kimi K3 to gpt-oss-20b, qwen3.6-35b-a3b, or gemma4-26b-a4b.
by lostmsu 2mo ago
Not directly related to their project, but perhaps it could make sense to distill something like Kimi K3 to gpt-oss-20b, qwen3.6-35b-a3b, or gemma4-26b-a4b.
- cgorlla 2mo ago>We plan to test what happens with a Chinese teacher into a Chinese-lineage base like Qwen next. :)