3 ms·
66% isn’t low utilization. You’re always going to have micro spikes, and you never want to clip, so keeping some headroom around feels smart. Unless you co-min
by ec109685 3y ago
66% isn’t low utilization. You’re always going to have micro spikes, and you never want to clip, so keeping some headroom around feels smart.
Unless you co-mingle online and offline (batch) traffic on same hosts, flat response times and high utilization aren’t compatible.
- sitkack 3y agoHigh utilization means high variability and low resiliency and the last k-percentage of utilization causes highly non-linear effects.
- ec109685 3y agoSmart budgeted retries can help smooth those peaks.
- kccqzy 3y agoWhile I agree there's always going to be micro spikes and keeping some headroom is smart, 33% may be too much of a headroom for all but the most latency sensitive RPC services. Personally I aim for only 20% headroom.