4 ms·
Qwen3.8-Flash-Next loads in 60gb on quant4. Thats pretty close to consumer hardware.
by cyanydeez 1mo ago
Qwen3.8-Flash-Next loads in 60gb on quant4. Thats pretty close to consumer hardware.
- mkl 1mo agoIs it any good at autoformalisation? I think it's likely to take focused fine-tuning to get something small enough that is still good at that.
- cyanydeez 1mo agoso far unsloth only has https://unsloth.ai/docs/models/qwen3.8/train https://unsloth.ai/docs/models/qwen3.8/train which is the 27B model. It also getting pretty close to what you'd need. I wouldn't be surprised if someone is trying it.