4 ms·

Because the cost is a lot lower. Paying a few percent of overcapacity doesn’t change that.

• aidenn0 2y ago
  TFA suggest a 900% overcapacity, not a few percent. I just skimmed GP's article but it seems to suggest a ~100% overcapacity for streaming-video specifically.
  • nine_k 2y ago
    "100% overcapacity" is also known as "50% load factor". It's common knowledge to run your API nodes at 20%-60% CPU load, no more, exactly to curb tail latency.
    • sambazi 2y ago
      just think about your competitive edge if you could manage to cramp more load w/o affecting latency
      • jdougan 2y ago
        Depends on what you have to pay (and not just in money) to get there.