3 ms·
My guess is they use a 0 / small queue in front of the request pool. If queue is full (indicating the server is at its concurrency limit), it returns a 429 (whi
by nvarsj 9y ago
My guess is they use a 0 / small queue in front of the request pool. If queue is full (indicating the server is at its concurrency limit), it returns a 429 (which is sort of weird - return a 503 instead). I don't think that is part of the library though - the library just provides the low level bricks.
- ad-hominem 9y agoThe 429 is to inform clients they should do something else ("it's your fault"). A 503 would indicate it was the server's problem and maybe they should retry. A server at capacity does not want the client to retry directly to it, it wants the client to look elsewhere (even if that means retrying against the load balancer). It's a small semantic difference, but since netflix controls all the clients and servers, it's kind of a preference thing.