4 ms·
>> highest performance with regards to production usage Not really, no. I've been using TensorRT for that quite successfully. If you can work around its limita
by m0zg 7y ago
>> highest performance with regards to production usage
Not really, no. I've been using TensorRT for that quite successfully. If you can work around its limitations, I don't think anything can compete, at least not on modern NVIDIA GPUs. And yes, I'm aware TF can use TensorRT as well. But why drag in all of TF if you just want inference?