3 ms·
Depending on your request rate and how much higher the latency is than usual, I could see wanting a tool with full-system visibility rather than just independen
by spiffytech 3y ago
Depending on your request rate and how much higher the latency is than usual, I could see wanting a tool with full-system visibility rather than just independent timeouts at the call site.
Some examples of holistic problems:
How many partially-processed requests can you hold in memory at once as they pile up under that delay?
If the downstream service suddenly fulfills all the pending requests at once, does the thundering herd cause your service to overload other systems?