Isn't BNNS documented to run on the CPU? Why would you expect it to use the neural engine? Apple also has Metal Performance Shaders which of course run on the G

Isn't BNNS documented to run on the CPU? Why would you expect it to use the neural engine? Apple also has Metal Performance Shaders which of course run on the GPU only. The user accessible API for the neural engine is Core ML. Very high level unfortunately. Hmm, it seems like there's also a new API that can use the neural engine sometimes, "ML Compute". But only for inference? https://developer.apple.com/documentation/mlcompute/mlcdevice/3750437-ane https://developer.apple.com/documentation/mlcompute/mlcdevic...