4 ms·
At least one link/benchmark I saw said the ANE can be 7x faster than GPU (Metal / MPS), https://discuss.pytorch.org/t/apple-neural-engine-ane-instead-of-additi
by ks2048 1y ago
At least one link/benchmark I saw said the ANE can be 7x faster than GPU (Metal / MPS),
https://discuss.pytorch.org/t/apple-neural-engine-ane-instead-of-additionally-to-gpu-on-m1-m2-chips/182297 https://discuss.pytorch.org/t/apple-neural-engine-ane-instea...
It seems intuitive that if they design hardware very specifically for these applications (beyond just fast matmuls on a GPU), they could squeeze out more performance.
- astrange 1y agoPerformance doesn't matter. Nothing is ever about performance. It's about performance/power ratios.