Another trick for reducing tail latency with minimal utilization increase is to fire the second call earlier but send a cancellation signal when the first respo

Another trick for reducing tail latency with minimal utilization increase is to fire the second call earlier but send a cancellation signal when the first response arrives (e.g. a udp packet is usually good enough). This works when the cost of managing the request queue is low relative to the coat of serving the requests themselves (usually true whenever there is some IO involved).