4 ms·
How to run Qwen3.8-27B on a single 16GB card
- fzysingularity 29d agoHave you tried any vision tasks with this model? We've been serving these on our gateway [1], and the quants are quite terrible for vision. Curious to hear your experience. [1] https://www.vlm.run/gateway https://www.vlm.run/gateway