3 ms·
Honest question/suggestion for the HN audience- Since Qwen released the weights for Qwen3.8 2.4T-A95B and we already have the staring point of Qwen3.6 35B-A3B,
by parsimo2010 2mo ago
Honest question/suggestion for the HN audience- Since Qwen released the weights for Qwen3.8 2.4T-A95B and we already have the staring point of Qwen3.6 35B-A3B, couldn't someone distill the bigger model and make a "pseudo" Qwen3.8 35B-A3B? Sure, it wouldn't be an official Qwen release but couldn't someone improve on Qwen 3.6 and get the thing everyone is asking for?
I am calling this a suggestion for the audience because I don't have the will/resources to do this.
- WASDx 2mo ago"Qwen3.8 35B-A3B" and 4B/9B variants are already on huggingface distilled by hobbyists.
- karlkloss 2mo ago>I can't find any. Do you have a link?
- KronisLV 2mo agohttps://huggingface.co/Lord-H4D3ZS/Qwen3.8-Distill-35B-A3B-Coder-Abliterated https://huggingface.co/Lord-H4D3ZS/Qwen3.8-Distill-35B-A3B-C... > Base / architecture: Qwen/Qwen3.6-35B-A3B (Qwen3_5MoeForCausalLM, 256 experts, ~3B active). The "3.8" in the name refers to the teacher, not the base. Not endorsement, haven't run it myself, just found the link.
- parsimo2010 2mo ago[dead]
- halJordan 2mo agoYes, of course. But no one really wants to be the guy actually renting an entire B300.