2 ms·
I haven't tried it yet but there's an MLX project that exposes an OpenAI-compatible serving endpoint that should work with Open WebUI: https://github.com/madroi
by simonw 2y ago
I haven't tried it yet but there's an MLX project that exposes an OpenAI-compatible serving endpoint that should work with Open WebUI: https://github.com/madroidmaq/mlx-omni-server https://github.com/madroidmaq/mlx-omni-server
- codybontecou 2y agoAppreciate the link. I'll try to tinker with it later today.