5 ms·

lets say for the argument sake it's 50 billion thats 20k/sec there is zero need to for a fancy setup at this scale

• cookiengineer 5y ago
  I am not sure you are aware that server load is never linearly distributed. And that's the exact problem OP is talking about. If everybody would get a ticket number and do requests when they're supposed to do them, we wouldn't need load balancers.
  • qaq 5y ago
    This is orthogonal to what causes the pain point. All the pain comes from distributed state and these load levels even if you peak at 800K requests per second you don't need distributed state. So most of this pain is self inflicted.
    • cookiengineer 5y ago
      True, I agree. In most systems I've seen, the caching layer is invalidated more often than necessary, and most of the traffic could've been avoided with a better URL scheme that's more expressive in regards to its content (mutations).