3 ms·

i found the exact opposite, the pytorch version on the cpu barely does over 2 times realtime while i can get the onnx int8 version to reach 5x.