4 ms·
i need some experience from anyone. which model is good for local usage. i prefer moe models, since im only running 4gb vram. i used to play around with qwen 3.
by h4fizwasabie 2mo ago
i need some experience from anyone. which model is good for local usage. i prefer moe models, since im only running 4gb vram. i used to play around with qwen 3.6 35b a3b with 17/tps. its been few months since i last play around with local LLM. is there any improvement on local ai development?