3 ms·
Super interesting, but it would probably help the pytorch performance significantly on both the gpu and cpu if they torchscripted the models, it's probably pret
by chessgecko 5y ago
Super interesting, but it would probably help the pytorch performance significantly on both the gpu and cpu if they torchscripted the models, it's probably pretty simple given they exported it to onnx and would be more apples to apples
It'll be exciting to see what they can do with the a10 gpus when they're available.
- m3at 5y agoAfaik models exported to onnx are already jit compiled in the export process: https://pytorch.org/docs/stable/onnx.html https://pytorch.org/docs/stable/onnx.html
- chessgecko 5y agoI was referring to the benchmark script from the article https://github.com/neuralmagic/deepsparse/blob/main/examples/ultralytics-yolo/benchmark.py https://github.com/neuralmagic/deepsparse/blob/main/examples... It looks like they used torch.load instead of torch.jit.load so I don’t think it’s scripted here, but I didn’t check the model file itself so I’m not entirely sure