3 ms·If you can do inference on the CPU, drop the GPU : it should be faster.by AureliusMA 2mo agoIf you can do inference on the CPU, drop the GPU : it should be faster.