3 ms·Proxying inference requests in 6ms with Pingora, Envoy, and Spanner2 points by birdculture 4mo ago