4 ms·
If each server can handle thousands of operations at a time, the duration of each operation shouldn't matter because long operations should also be evenly sprea
by grosjona 9y ago
If each server can handle thousands of operations at a time, the duration of each operation shouldn't matter because long operations should also be evenly spread across servers... Also due to probability.
When you're dealing with big numbers across relatively few servers, randomness averages out everything.
- kd5bjo 9y agoIt depends on how long your long operations are. Back when I was working on Justin.tv, we had to write a custom load balancer because we had to maintain a sizable number of TCP connections that lasted for hours or days without disconnecting.
- grosjona 9y agoI've worked on a cryptocurrency trading platform that had WebSocket connections which also sometimes lasted for days (including trading bots). Each user-facing server could handle 10k concurrent sockets and the long connections were spread out evenly. When you have a sample of 10k users, they tend to behave consistently with any other 10k sample... Assuming that all machines are the same size and the code is the same on all machines.