2 ms·
There is a Gemma 4 model with 12B parameters which might be worth trying. e.g. https://huggingface.co/mlx-community/gemma-4-12B-it-qat-4bit https://huggingface
by mft_ 3mo ago
There is a Gemma 4 model with 12B parameters which might be worth trying. e.g. https://huggingface.co/mlx-community/gemma-4-12B-it-qat-4bit https://huggingface.co/mlx-community/gemma-4-12B-it-qat-4bit
That said, your computer will still get hot!
- Daunk 3mo agoI just run Gemma4 12B MLX via Ollama and it's been doing fantastic work!