3 ms·

I'm not a ML guy, but when I needed to train a NN I thought that the my Mac's ANE would help. But actually, despite it being way easier to setup tensorflow + me

I'm not a ML guy, but when I needed to train a NN I thought that the my Mac's ANE would help. But actually, despite it being way easier to setup tensorflow + metal + M1 on Mac than to setup tensorflow + cuda + nvidia on Linux, the neural engine cores are not used. Not even for classification, which are their main purpose. I wouldn't say they are wasted silicon, but they are way less useful than what we expect

mr_toad 1y ago
Does Apple care about third party use of the ANE? There are many iOS/iPadOS features that use it.
- sroussey 1y ago
  Not really. Apple software uses the neural engine all over the place, but rarely do others. Maybe this will change [1] There was a guy using it for live video transformations and it almost caused the phones to “melt”. [2] [1] https://machinelearning.apple.com/research/neural-engine-transformers https://machinelearning.apple.com/research/neural-engine-tra... [2] https://x.com/mattmireles/status/1916874296460456089 https://x.com/mattmireles/status/1916874296460456089