4 ms·
if a request takes 100 ms, and a portion of them are murdered halfway through then either clients retry for reliability in exchange for extra latency, or reliab
by mathgladiator 6y ago
if a request takes 100 ms, and a portion of them are murdered halfway through then either clients retry for reliability in exchange for extra latency, or reliability takes a hit.
The best policy is for a deployment to lower the health check on the service, wait a few minutes per box, then bounce the process.
This is assuming the service is 100% stateless.