3 ms·
The shared ram and neural engine make for an interesting/powerful platform if people are willing to port to it.
by matwood 4y ago
The shared ram and neural engine make for an interesting/powerful platform if people are willing to port to it.
- steve_adams_86 4y agoAre the neural engines able to be leveraged by 3rd parties yet? I thought there was no API available yet.
- rnosov 4y agoThey are leveraging Apple’s Metal Performance Shaders[1] not the neural engine. From the chart, it looks like you might get ~20x max boost on inference over plain CPU. Obviously, it's not like having RTX 4090 but better than nothing. [1] https://pytorch.org/blog/introducing-accelerated-pytorch-training-on-mac/ https://pytorch.org/blog/introducing-accelerated-pytorch-tra...
- wmf 4y agoCoreML is the API.