29 ms·
MLX does not run on NPUs AFAIK; just gpu and cpu. You have to use CoreML to officially run code on the neural engine.
by nullstyle 7mo ago
MLX does not run on NPUs AFAIK; just gpu and cpu. You have to use CoreML to officially run code on the neural engine.
- mirsadm 7mo agoEven then there is no transparency on how it decides what runs on the ANE/GPU etc
- sroussey 7mo agoCorrect. OS level stuff get first priority, so you can’t count on using it.
- znagengast 7mo agoTurns out third party actually gets priority for ANE