Tensorflow does do really well when it comes to serving models in production. Tensorflow serving or TensorRT 3 are fairly throughput efficient and low latency.

Tensorflow does do really well when it comes to serving models in production. Tensorflow serving or TensorRT 3 are fairly throughput efficient and low latency. PyTorch, for instance, does not have a good serving solution (I guess that's where Caffe2 is useful)