2 ms·
Can you run the mlx-variation of this model through Ollama so that I can interact with it in Open WebUI?
by codybontecou 1y ago
Can you run the mlx-variation of this model through Ollama so that I can interact with it in Open WebUI?
- simonw 1y agoI haven't tried it yet but there's an MLX project that exposes an OpenAI-compatible serving endpoint that should work with Open WebUI: https://github.com/madroidmaq/mlx-omni-server https://github.com/madroidmaq/mlx-omni-server
- codybontecou 1y agoAppreciate the link. I'll try to tinker with it later today.