3 ms·
Do any frameworks manage to use the neural engine cores for that? Most stuff ends up running Metal -> GPU I thought
by anentropic 7mo ago
Do any frameworks manage to use the neural engine cores for that?
Most stuff ends up running Metal -> GPU I thought
- abhikul0 7mo agoIt's referring to the neural cores(for matrix mul) in the GPU itself, not the NPU. https://creativestrategies.com/research/m5-apple-silicon-its-all-about-the-cache-and-tensors/ https://creativestrategies.com/research/m5-apple-silicon-its...
- sumek83 7mo agohttps://github.com/maderix/ANE https://github.com/maderix/ANE