You can try it with this model here: https://hugston.com/models/56tps-tested-autoround-qwen35-35b-a3b-q2-k-s https://hugston.com/models/56tps-tested-autoround-q

You can try it with this model here: https://hugston.com/models/56tps-tested-autoround-qwen35-35b-a3b-q2-k-s https://hugston.com/models/56tps-tested-autoround-qwen35-35b... which is really well done and can run pretty fast with ctx up to 300k. Just 11.65 GB. Get the Mmproj also for vision/image processing.