3 ms·
The C10k problem was challenging around the turn of the century. I suppose it's now not. I wonder how much CPU would be saved using an event-based architecture.
by kccqzy 7y ago
The C10k problem was challenging around the turn of the century. I suppose it's now not. I wonder how much CPU would be saved using an event-based architecture.
- milesvp 7y agoEven in 2007 when I was starting to cut my teeth on larger web traffic there was a lot of discussion around serving 10k concurrent connections. I remember being blown away by a graph showing high throughput at 70k concurrent by a YAWS server, and started following Erlang as a result.
- aeyes 7y agoIn 2004 we had eDonkey servers handling 1M concurrent connections. Code, changelog and a bit of history: https://lugdunum.shortypower.org/kiten.html https://lugdunum.shortypower.org/kiten.html
- milesvp 7y agoOh, wow, I vaguely remember running across eDonkey at one point. I don't think I ever realized it could handle that kind of load. I was in a position to mostly stick with Apache for various non technical reason basically for long enough that eventually Apache got to the point that it could handle the traffic I needed to deal with especially with a CDN in front of it.
- dmix 7y agoC10k problem is now C10M, from wikipedia: > By the early 2010s millions of connections on a single commodity 1U server became possible: over 2 million connections (WhatsApp, 24 cores, using Erlang on FreeBSD), 10–12 million connections (MigratoryData, 12 cores, using Java on Linux). https://en.wikipedia.org/wiki/C10k_problem https://en.wikipedia.org/wiki/C10k_problem
- monocasa 7y agoYeah, the cutting edge is C10M now. C10K was solved by switching to an event system like epoll or kqueue. This decreased the big O complexity of kernel<->user information flow so that you don't pay more for listening on more sockets. C10M seems to be solved by colocating the network stack and app stack data structures by running the driver and the app in the same context. This can be achieved via DPDK-like schemes or pushing more into the kernel like Netflix's work to push TLS into kernel sockets that you can sendfile to.