3 ms·
Software wise there's plenty to choose from already. Ollama/llama.cpp, LM Studio, Lemonade, vllm etc. Anything Apple would bring to the table?
by Matl 1mo ago
Software wise there's plenty to choose from already. Ollama/llama.cpp, LM Studio, Lemonade, vllm etc. Anything Apple would bring to the table?
- evilduck 1mo agoMaybe https://mlx-framework.org https://mlx-framework.org FWIW, Ollama, LM Studio and Lemonade (and oMLX) also wrap Apple's MLX framework.