3 ms·
> additional challenge of offering it over a network socket across multiple requests and doing so in a performant manner. @kkielhofner thanks a lot! now I real
by backend-dev-33 2y ago
> additional challenge of offering it over a network socket across multiple requests and doing so in a performant manner.
@kkielhofner thanks a lot! now I realize it. I see, there is even GRPC support in Triton, so it make sense.
- kkielhofner 2y agoMake sure to check out the existing Triton client libraries: https://github.com/triton-inference-server/client https://github.com/triton-inference-server/client