4 ms·
If you're on macOS, check out the MLX community: https://huggingface.co/mlx-community https://huggingface.co/mlx-community - Ollama not needed, potentially more
by ndr_ 2y ago
If you're on macOS, check out the MLX community: https://huggingface.co/mlx-community https://huggingface.co/mlx-community - Ollama not needed, potentially more efficient(?). The Gemma 2 27B model was broken as of a few days ago, but a fix is already committed and underway to the pip repo. Gemma 2 9B works directly.
- MikeBee 2y agoThanks! I've been using gemma 2 9B and Llamma3 8B interchangeably. They're both really good models.