3 ms·
How are you running these together, splitting the model somehow or did you mean different models on any one card at a time?
by eklavya 3mo ago
How are you running these together, splitting the model somehow or did you mean different models on any one card at a time?
- zepearl 3mo agoI always run just one model at once, I switch between them depending on what I do (e.g. Qwen3.6 27B Q5_K_M by Bartowski when programming with "OpenHands" and when doing OCR text transcription and transformation, Gemma4 31B-it Q5_K_M by Bartowski when chatting in Open WebUI doing general tasks).