3 ms·
Try qwen3-coder or qwen3-coder-next models which fit into your configuration. This is team-of-experts model which may load only actual experts into GPU.
by denn-gubsky 4mo ago
Try qwen3-coder or qwen3-coder-next models which fit into your configuration. This is team-of-experts model which may load only actual experts into GPU.
- limondas 4mo agoThanks for your reply. But it's to big for my PC. In PC around 1.5GB models got 20 token/s , which is too low for agentic workflow.
- denn-gubsky 4mo agotry latest gemma4:12b. It fits into 16Gb with 256K context window