3 ms·
Just to add some ballparks: I have a yolov5 model that I run in PyTorch on a 3080 and the inference time is roughly 20ms. And inference with a 200estimator ran
by hetspookjee 4y ago
Just to add some ballparks: I have a yolov5 model that I run in PyTorch on a 3080 and the inference time is roughly 20ms.
And inference with a 200estimator random forest is a few ms on a cpu.
I can imagine that in some scenarios it’s not enough though.
- kroolik 4y agoIndeed it might not be enough, and there is no one size that fits them all ;) For inference times of 50ms I wouldn't bother complicating the setup that much. Again, it all depends on your requirement and trade offs available.