This is very nice and I really like the CLI aspect. I would have one feature request: Serve the model via GrPC. Im running ML in production for the last 4 year

This is very nice and I really like the CLI aspect. I would have one feature request: Serve the model via GrPC. Im running ML in production for the last 4 years in the field of biology and need > million predictions per hour. Load-balacing on multiple servers (and staying with http request based predictions) is not an options as the latency would kill the application. Am I in such niche? Or other question: are there many more people that run fine-tuned TF servings/TensorRT servers to keep up with the production need?