3 ms·
While 400 TPS might not be huge, there is still a lot of processing that goes into placing each order, and it's easy to underestimate the necessary capacity. La
by qiller 3y ago
While 400 TPS might not be huge, there is still a lot of processing that goes into placing each order, and it's easy to underestimate the necessary capacity. Latencies add up (a call to a tax service, a call to a shipping service, etc), state adds up, and suddenly it's way over 1%.
- ndriscoll 3y agoLatency doesn't affect throughput. As soon as you fire off a call to an external vendor, your server can work on processing the next request. It doesn't matter if that call takes 10 ms or 5 seconds. Even if it took 30 seconds, that means you need to be able to handle 12k concurrent requests (almost all of which are asleep), which is nothing.