2 ms·
Q3 XL and Q3 XS are the two I'm trying to decide on
by jadbox 26d ago
Q3 XL and Q3 XS are the two I'm trying to decide on
- dofm 26d agoYou might want to test this new dynamic GGUF: https://huggingface.co/ISTA-DASLab/Qwen3.8-27B-GSQ-RCO-GGUF https://huggingface.co/ISTA-DASLab/Qwen3.8-27B-GSQ-RCO-GGUF (I don’t know much about it, just saw a YouTube video about it last night)
- kennywinker 26d agoAnother one to try: https://huggingface.co/Jackrong/Qwopus3.8-27B-Flash-GGUF https://huggingface.co/Jackrong/Qwopus3.8-27B-Flash-GGUF Runs the 3bit model faster than the 2bit one runs on my old-ass card. Can’t vouch for its intelligence yet, but i suspect whatever loss in smarts it takes is made up for by the extra resolution.