4 ms·
> You cannot spin up 100K native > threads to handle 100K requests that are IO bound (which is very common in a microservice architecture, since requests will v
by adev_ 7y ago
> You cannot spin up 100K native > threads to handle 100K requests that are IO bound (which is very common in a microservice architecture, since requests will very quickly block on requests to other services)
The Varnish server does that all the time and it is not a problem.
Modern OS handle a large number of threads much better than 10 years ago.
In case of python however, you can not do that due to the GIL and the fact python handle native threading terribly.
- mborch 7y agoFrom the docs: > We rarely recommend running with more than 5000 threads. If you seem to need more than 5000 threads, it’s very likely that there is something not quite right about your setup, and you should investigate elsewhere before you increase the maximum value.
- adev_ 7y ago> We rarely recommend running with more than 5000 threads. If you seem to need more than 5000 threads, it’s very likely that there is something not quite right about your setup, and you should investigate elsewhere before you increase the maximum value. Yes, and still 5000 will be more than enough to serve most of production load. Even on high traffic websites.