5 ms·
Why are you using Ollama? Just use llama.cpp brew install llama.cpp use the inbuilt CLI, Server or Chat interface. + Hook it up to any other app
by robotswantdata 6mo ago
Why are you using Ollama? Just use llama.cpp
brew install llama.cpp
use the inbuilt CLI, Server or Chat interface. + Hook it up to any other app
- Bigsy 6mo agoFor MLX I'd guess.
- redrove 6mo agohttps://omlx.ai/ https://omlx.ai/
- wronglebowski 6mo agoThat also comes upstream from llama.cpp https://github.com/ggml-org/llama.cpp/discussions/4345 https://github.com/ggml-org/llama.cpp/discussions/4345