3 ms·
> It's a well-understood paradigm that has worked for a long time. The situation is quite simple, and governed by Little's law. If your number of threads is gr
by pron 5y ago
> It's a well-understood paradigm that has worked for a long time.
The situation is quite simple, and governed by Little's law. If your number of threads is greater than the average request rate times the average processing latency (of processing a request entirely on a single thread), then you're all good and it's a well-understood paradigm that's worked for many years. If, on the other hand, that number of threads is smaller than that multiple, then that well-understood paradigm is well-understood to have crashed servers for many years, requiring many more of them even when their utilisation is low. If you're on one side of this, then you don't have a problem to begin with. Loom exists because increasingly more people are on the other side of this problem, where they need multiple servers.