4 ms·

Is that a CPU based inference build? Shouldn't you be able to get more performance out of the M3's GPU?

• wmf 2y ago
  Inference is about memory bandwidth and some CPUs have just as much bandwidth as a GPU.