3 ms·
Also FYI doesn't run inference on Apple GPU (only for training)
by neilellis 8d ago
Also FYI doesn't run inference on Apple GPU (only for training)
- HenryNdubuaku 8d agoHey there, yep we found that on Apple devices specifically running on CPU is fast enough that Metal support is not needed. Thanks for flagging this though, and if usecases that would benefit from Metal support come up we will be adding it to the binaries.