3 ms·
I assume people are working on bringing a MLX backend to llama.cpp... Any idea what the state of that project is?
by sbrother 3y ago
I assume people are working on bringing a MLX backend to llama.cpp... Any idea what the state of that project is?
- tgtweak 3y agohttps://github.com/ml-explore/mlx-examples https://github.com/ml-explore/mlx-examples Several people working on mlx-enabled backends to popular ML workloads but it seems inference workloads are the most accelerated vs generative/training.