4 ms·
"100% overcapacity" is also known as "50% load factor". It's common knowledge to run your API nodes at 20%-60% CPU load, no more, exactly to curb tail latency.
by nine_k 2y ago
"100% overcapacity" is also known as "50% load factor".
It's common knowledge to run your API nodes at 20%-60% CPU load, no more, exactly to curb tail latency.