3 ms·
Unless something changed recently, I’m not aware of big perf differences between MLX and llama.cpp on Apple hardware.
by hnfong 2y ago
Unless something changed recently, I’m not aware of big perf differences between MLX and llama.cpp on Apple hardware.
- loufe 2y agoI'm under the same impression. Llama.cpp's readme used to start with "Apple Silicon as a First Class Citizen", and IIRC Georgi works on Mac himself.