3 ms·Inference is about memory bandwidth and some CPUs have just as much bandwidth as a GPU.by wmf 2y agoInference is about memory bandwidth and some CPUs have just as much bandwidth as a GPU.